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■^An  examination  of  formal  trainincj  of  airmen  in  the 
care-r  fields  rospoti'ible  for  flight-line  mainte- 
nance of  advanced  avionics  equipment.  Initial  train- 
ing for  flight-line  maintenance,  training  at  Field 
Training  Detachments.  TAC’s  Ta'k  Oriented  Training 
program,  and  the  management  of  r.'aining  are  investi- 
gated. The  study  shov/s  that  in  initial  training 
there  was  too  much  emphasis  on  theory  and  not 
enough  on  the  practical  knowledge  and  skills 
needed  on  the  job.  There  v;as  too  little  train- 
ing on  systems  integration  and  troubleshooting 
integrated  systems.  To  better  prepai e technicians 
^or  advanced  avionics  maintenance,  formal  training 
should  teach  Job  performani.e  (rather  than  theory), 
should  take  place  at  the  base  and  on  the  equipment 
the  airman  will  be  associated  with,  and  should  be 
interspersed  with  actual  job  experience.  Training 
should  be  tailored  to  tiie  needs  of  school  personnel 
on  training  development  and  field  evaluation  of 
cra‘'ning  should  be  lessened  by  having  the  users  of 
trained  personnel  become  active  partners  in  the 
management  of  training.  See  also  R-2017-AF  and 
R-2049-AF.  (JOD)  fv 
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PREFACE 

This  is  part  of  a study  requested  by  the  Tactical  Air  Coonand 
because  of  problems  arising  from  the  support  of  advanced  avionics 
systems.  The  material  presented  here  in  response,  while  highlighting 
the  training  of  technicians  who  work  on  integrated  avionics  systems 
on  the  flight  line,  in  fact  has  broad  implications  for  Air  Force 
technical  training  in  general.  It  was  provided  to  the  Air  Force  in 
draft  form  and  was  widely  briefed  in  the  fall  of  1975.  The  major 
audiences  were  Rand's  Air  Force  Advisory  Group;  v<irious  planners  in 
the  Air  Staff;  the  Commander,  Air  Training  Command;  and  the  Vice 
Commander,  TAC, 

In  January  1976,  the  Chief  of  Staff  of  the  Air  Force  established 
an  ad  hoc  group  to  look  for  ways  to  cut  the  cost  of  training.  This 
action  was  concurrent  with  ATC's  reduction  of  basic  electronics 
training  and  revision  of  the  training  given  aircraft  crew  chiefs  to 
make  it  specific  to  the  job.  These  efforts  led  the  ATC  Commander  in 
April  1976  to  establish  a major  study  effort,  hasty  Grad,  to  review 
training  policy  and  if  necessary  to  revise  it  to  ensure  the  relevance 
of  technical  training.  Rand  is  a member  of  the  Hasty  Grad  group. 

The  reader  should  therefore  keep  in  mind  the  possible  outcomes 
of  the  Hasty  Grad  deliberations.  Our  study  raises  serious  doubts 
about  Air  Force  training  policy  and,  as  noted,  has  major  implications 
for  the  manpower,  personnel,  and  training  systems.  Accordingly,  one 
of  the  basic  purposes  of  the  Hasty  Grad  group  is  to  evaluate  these 
and  related  recommendations  in  an  attempt  to  ensure  the  relevance  and 
efficiency  of  technical  training. 
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This  report  is  one  of  a series  examining  personnel  and  training 
support  for  advanced  avionics  systems.  Others  are: 

R-2017-AF,  ^a lysis  of  the  Content  of  Advanced  Avionics 
Maintenance  Jobs,  Polly  Carpenter-Huf fman,  John  Neufer, 
and  Bernard  Rostker. 

R-20A9-AF,  A Proposed  Course  for  Avionics  Technicians, 

Richard  E.  Duren. 

The  research  was  conducted  for  Project  AIR  FORCE  (formerly  Project 
RAKD)  under  the  study  project  "Personnel  and  Training  Support  for 
New  Avionics  Systems." 
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SUMMARY 


The  study  frrn  which  this  report  emanated  was  requested  by  the 
Tactical  Air  Command  because  of  problems  arising  from  the  support  of 
the  avionics  systems  in  the  F-IIID  aircraft.  TAC,  recognizing  the 
complex  nature  of  the  problems,  emphasized  examination  of  Air  Force 
management  and  training  of  maintenance  personnel  as  well  as  hardware 
and  software  reliability.  This  report  examines  formal  training  of 
personnel  for  flight-line  maintenance  of  all  models  of  the  F-llI, 
concentrating  on  the  bomb/nav  systems  in  the  F-lllD. 

One  of  the  overriding  impressions  we  received  during  extensive 
visits  to  all  CONUS  F-111  and  F-15  bases  and  to  the  F-16  System 
Project  Office  is  the  pervasiveness  of  the  personnel  support  problem. 
Although  TAC  highlighted  the  F-lllD,  we  found  the  same  problems  in 
varying  degrees  with  all  integrated  avionics  systems.  The  integrated 
avionics  system  of  the  F-lllD  is  at  the  frontier  of  technology  and  is 
the  most  difficult  to  maintain.  Hence,  deficiencies  in  personnel 
support  are  most  obvious  for  this  aircraft.  Thus,  while 
concentrating  on  the  F-lllD,  our  findings  and  recommendations  have 
more  general  application. 

Integrated  avionics  systems  are  distinctly  different  from 
earlier  systems,  although  they  perform  the  same  functions  of 
navigation,  flight  control,  communications,  and  weapon  control.  In 
earlier  systems,  each  function  was  carried  out  by  separate  pieces  of 
equipment.  In  integrated  systems,  sensors  and  displays  are  tied 
together  in  a central  computer  complex  via  analog/digital  converters. 
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Maintenance  of  earlier  avionics  systeas  focused  on  the  separate 
pieces  of  equipment,  and  personnel  in  the  same  career  field  could 
work  on  the  equipment  for  which  they  were  responsible  either  on  the 
flight  line  or  in  the  intermediate  shop.  But  integrated  avionics 
systems  are  composed  of  sealed  boxes;  faulty  boxes  are  identified 
through  the  use  of  self-test  equipment  on  board  the  aircraft.  The 
flight-line  technician's  responsibility  is  to  remove  and  replace 
faulty  boxes,  which  are  then  tested  on  special  test  stations  in  the 
intermediate  shop.  The  shop  technician's  responsibility  is  to 
operate  the  test  stations.  The  very  different  nature  of  flight-line 
and  shop  procedures  led  the  Air  Force  eventually  to  assign 
flight-line  and  shop  technicians  to  separate  career  fields. 

Use  of  the  built-in  fault-isolation  capability  would  make  the 
flight-line  job  routine  if  the  system  provided  unambiguous 
indications  of  failure.  Such  is  not  the  case,  not  only  because 
indicators  are  unreliable  but  because  malfunctions  may  occur  in 
several  systems  at  once.  Moreover,  a malfunction  in  one  system  often 
affects  the  performance  of  a totally  different  system. 

To  evaluate  training,  we  first  had  to  establish  the  content  of 
the  flight-line  maintenance  job  in  terms  of  the  skills  and  knowledge 
it  requires.  Because  maintenance  of  the  F-111  departs  so  radically 
from  maintenance  of  earlier  avionics  systems,  we  undertook  a unique 
data  collection  effort  to  establish  the  content  of  the  job.  We  fouitd 
that  existing  data  collection  systems,  i.e..  Occupational  Survey  and 
"66-1"  maintenance  activity  reports,  either  did  not  cover  flight-line 
avionics  maintenance  or  did  not  capture  the  implications  of  task 
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performance  for  training.  We  therefore  developed  an  "observation 
interview"  procedure  at  Nellis  and  Mountain  Home  Air  Force  Bases  and 
applied  it  at  Cannon  Air  Force  Base,  where  the  F-1110  is  stationed. 

In  order  not  to  disturb  normal  work  patterns  and  to  maximize  the 
number  of  cases  an  interviewer  could  efficiently  handle,  we  debriefed 
maintenance  teams  immediately  as  they  came  off  a job.  During  the 
first  two  weeks  of  April  1975,  we  were  able  to  flow  chart  188  jobs. 
Comparison  of  the  jobs  with  Base  Level  Information  System  records 
shows  that  our  sample  was  not  unrepresentative  of  normal  work 
patterns . 

Our  analysis  showed  that  the  most  demanding  part  of  the 
job--finding  the  bad  box  when  self-test  fails  to  do  80--requires  the 
informed  use  of  combinations  of  the  external  indicators  provided  by 
the  system;  this,  in  turn,  requires  that  the  airman  know  how  the 
system  is  integrated,  what  functions  are  performed  in  what  boxes,  and 
how  a failure  in  a particular  box  affects  the  system.  Furthermore, 
the  avionics  systems  on  each  model  of  the  F-111  are  integrated  so 
differently  that  knowledge  of  one  does  not  presuppose  knowledge  of 
another. 

With  the  above  as  background,  we  examined  the  way  airmen  have 
been  and  are  being  trained  for  flight-line  maintenance.  Although  we 
concentrated  on  formal  training  for  the  critical  Bomb/Nav  shop  (Air 
Force  Specialty  326X2A) , we  also  examined  the  other  avionics 
flight-line  specialties  and  TAC's  Task  Oriented  Training  (TOT) 
program.  Even  before  we  began  our  study,  there  were  strong 
indications  that  something  was  wrong.  The  original  training  program 
stressed  "representative"  instruction,  i.e.,  training  on  an  item  of 
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equipnenl  that  was  thought  to  be  siatlar  to  or  representative  of  one 
or  more  other  pieces  of  equipment.  The  system  used  was  the  FB-lll, 
whicti  has  some  systems  found  on  no  other  model  of  the  F'lll  and  lacks 
some  syr’ems  that  play  key  roles  in  other  models.  In  1974,  the 
Avionics  Superintendent  Steering  Group  "concluded  that  the  present 
representative  training  is  not  meeting  the  demands  of  the  users...." 
They  recommended  "that  representative  training  be  replaced  with 
weapons  system  oriented  training."  What  was  not  generally  understood 
was  that  training  on  specific  avionics  systems  is  necessary  but  not 
sufficient  to  ensure  that  the  training  is  relevant  to  job 
performance . 

An  equally  important  problem  was  that  most  of  the  existing 
curriculum  was  theoretical  and  did  not  provide  the  technician  with 
the  practical  knowledge  or  skills  needed  on  the  job.  For  example,  30 
percent  of  the  course  dealt  with  basic  electronics  and  49  percent 
with  systems  familiarization.  Instruction  in  actual  job  performance 
was  limited  to  11  percent  of  the  course,  with  only  half  of  that  being 
hands-on  instruction. 

The  inadequacy  of  this  course  was  verified  in  several  ways.  As 
part  of  the  debrief  interviews  at  Cannon,  we  asked  each  technician 
about  the  source  of  training  he  had  received  for  each  step  of  the 
task.  In  the  Bomb/Nav  shop,  the  technical  school  course  was 
mentioned  as  the  source  of  knowledge  in  only  5.5  percent  of  the 
responses.  In  early  1974,  TAC  administered  a questionnaire  on  the 
adequacy  of  training  (among  other  subjects)  to  a large  number  of 
Specialty  Code  326  personnel  stationed  in  the  CONUS  and  overseas. 
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AlthoUKh  till-  Kiiiiia  i re  ili<l  not  |M>rinit  sl.ilistiral  analysis  of 

ri'sponsi's , th«>  lour  ot  1 h«*  rrsponses  was  flfar.  Training  in  basic 
elect ronics  was  irrelevant  to  the  job,  there  was  too  much  theory  and 
not  enough  practical  training,  and  there  was  too  little  training  on 
systems  integration  and  on  troubleshooting  integrated  systems. 
Moreover,  in  the  spring  ol  1974,  after  trips  to  Nellis  and  Mountain 
Home  Air  Force  Rases,  an  Air  Training  Command  (ATC)  evaluation  team 
noteil  similar  complaints  and  concluded  that  "most  graduates 
interviewed  considered  the  Lowry  (Technical  School)  course  inadequate 
for  doing  their  job." 

The  use  of  the  FH- 1 1 1 as  a training  vehicle  and  the  emphasis  of 
the  course  on  abstract  knowledge  were  partly  consequences  of  Air 
Force  training  policy.  Traditionally,  initial  training  has  been 
designed  to  provide  a base  for  an  airman's  performance  of  various 
duties  as  he  progresses  in  his  specialty  and  as  he  works  on  the 
various  weapon  systems  assigned  to  it.  Such  training  has  stressed 
general  knowledge  related  to  the  career  field  rather  than  the 
specific  job.  This  is  presumed  to  facilitate  flexible  assignment  of 
personnel  among  bases  and  weapon  systems.  in  the  case  of  integrated 
avionics,  however,  the  desired  transfer  of  learning  was  not  taking 
place  because  of  the  irrelevance  of  the  general  principles  taught  and 
the  idiosyncratic  nature  of  advanced  avionics  systems. 

The  need  for  training  in  practical  knowledge  and  skills  was 
clearly  understood  at  Cannon  Air  Force  Base.  The  27th  Tactical 
Fighter  Wing  extended  the  principles  of  job  performance  training 
embodied  in  the  experimental  Task  Oriented  Training  program  to  the 
training  of  Bomb/Nav  technicians.  Although  this  program  was  limited 
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1(1  B<)m\)/Nav  pcrsuniic  I , ils  IukI>  <l<•Kr(■«•  ol  at  {'cpt.iiii  c (Icnidiisl  ral  ••(!  the 
f f.is  1 hi  1 I ly  .111(1  potciilial  value  ol  .jol>  perl  orni. nice  IraiiiiiiK. 

Ill  the  meantime,  heiaiise  ol  coni  iTii  ahoijt  the  el  I e<  I i veneKs  ol 
representative  traininx.  ATC  developed  a new  two-phased  traiiiiiiK  plan 
lor  the  Homh/Nav  division  ol  the  career  lield.  I'hase  I included 
hasu  eleitronics  and  other  material  ( onuiion  to  tr.iiiiiiiK  lor  all 
Bomli/Nav  personnel  and  was  taiiKhl  at  l.owry  Teihnical  Siliool.  Phase 
II  was  conducted  at  live  CONDS  Field  'IrainiiiK  Detachments  ( FTDs ) , one 
lor  each  iiiodr' I ol  the  F- 1 I 1 and  lor  the  F-IS. 

Although  w(>  have  not  had  siilliiient  experiente  with  the  ri'vised 
loiirse  to  evaluate  its  graduates,  wr-  have  examineil  its  Basic  content 
in  detail.  l-irst,  without  speiilic  relerence  to  the  needs  ol  the 
joB,  il  siiBstaiit  I a I I y expandeil  Basil  electronics  to  40  percent  ol  the 
course.  Oiir  analysis  indiiateil  that  most  ol  this  tiainiii);  does  not 
add  to  the  effectiveness  ol  tliKht-line  iiia  i ntenani  e . This  conclusion 
IS  supported  By  a review  ol  the  Gi'neral  Dynamics  Fault  isolation 
Verification  Pribram  data  and  an  'iidependent  evaluation  By 
a member  of  Rand's  eiiKineerinn  stalf  (see  R-204‘J-AF). 

Second,  as  noted,  weapon  system  training  is  not  sufficient  to 
ensure  job  performance  training.  In  order  to  Better  understand  Phase 
II,  we  visited  Nellis,  Plattsburg,  and  Cannon  Air  Force  Bases.  In 
geneial.  Phase  11  instruction  was  developed  without  a detailed 
analysis  of  the  job,  without  an  approved  Specialty  Training  Standard 
(STS),  without  involvement  of  wing  personnel,  and  without  taking  full 
advantage  of  the  on-base  location  to  ensure  the  relevance  of  the 
hands-on  portion  of  training.  The  planned  courses  were  combinations 
of  the  previous  technical  school  and  FTD  courses. 


oiir  uiiilrrst.inilinx  ot  ttn*  jol),  th<>  (>xistllix 
tr.iiiiiM);  pronr.jm,  an<l  i)r»-vioiis  research  hy  Kani)  and  others,  we 
recommetid  that  Irainitig  he  developetl  for  tlixhl-litie  maintenance  of 
ailvanced  avionics  Ifi.il  stresses  five  principles: 

1.  Joh  I’ertormanci*  Should  Be  Taught.  Almost  all  of  the  skills 
anil  knowli'd^e  necessary  to  do  the  joh  must  he  learned  because  they 
are  not  part  of  the  average  person's  rep«*rtoire.  Most  cannot  be 
learned  or  derived  from  tun<lamental  principles.  Moreover,  the 
p<-rformance  of  tasks  that  arc*  idiosyncratic  to  specific  systems 
should  he  taught  on  the  actual  systems  or  adeijuate  facsimiles  of 
them . 

2.  Only  Joh  Performance  Should  Be  Taught.  Career  orientation 
of  entry-level  training  for  integrated  avionics  is  inefficient 
because  only  a small  percent  of  the  graduates  of  the  initial  course 
make  the  Air  Force  a career.  Our  analysis  of  Uniform  Airman  Records 
indicated  that  on  the  flight  line  only  IT. 9 percent  of  technical 
school  graduates  stay  until  their  fifth  year  of  service. 

3.  Job  Performance  Should  Be  Taught  Formally.  Currently,  the 
Air  Force  expects  most  job  skills  to  be  taught  informally  through  on 
the  job  training  (OJT).  However,  recent  studies  of  the  Human 
Resources  Research  Office  at  George  Washington  University  and  the  Air 
Force  Human  Resources  Laboratory  indicate  that  formal  training  of  job 
skills  is  more  effective.  Formal  training  provides  a controlled 
environment  that  ensures  that  aJJ  of  the  important  tasks  will  be 
taught,  that  each  trainee  will  be  taught  the  tasks,  and  that  he  will 
learn  to  do  the  tasks  correctly.  Teaching  job  performance  in  formal 
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tr<«inin);  produci's  an  airman  who  is  ot  immol  i ali‘  iisf'  to  the  operating 
unit  aiul  reituces  tin*  siihstantial  hidilen  cost  of  OJT. 

U , Job  Performance  Shoii  I <f  Be  Taught  Formally  at  the  Operating 
Base  ami  When  Neede*!.  Teaching  job  performance  at  the  operating  base 
improves  access  to  the  job  itself,  which,  if  taken  full  advantage  of, 
would  significantly  improve  the  relevance  of  training.  For  example, 
at  Cannon  Air  Force  Base,  Task  Oriented  Training  instructors  were 
taken  from  TAC  units  on  base.  The  instructors  were  afile  to  maintain 
better  contact  with  the  job,  the  idiosyncrasies  of  the  eijuipment,  and 
the  needs  of  the  shops.  Moreover,  base-level  training  would  be 
readily  available  to  instruct  the  technician  as  he  moves  between  jobs 
in  his  specialty  or  is  reassigned  to  bases  that  have  different  pieces 
of  equipment. 

?> . Initial  Formal  Training  Should  Be  Alternated  wiyi_Job 
Experience.  Because  of  the  complexity  of  the  equipment  and  the  job, 
alternating  periods  of  formal  training  with  actual  job  experience 
would  have  several  advantages.  It  would  shorten  the  initial  period 
of  training  and  enable  the  airman  to  perform  simple  tasks  while  they 
are  still  fresh  in  his  mind.  Actual  job  experience  would  provide  a 
frame  of  reference  and  motivate  him  to  the  more  intellectually 
demanding  tasks  of  troubleshooting.  In  short,  training  and  the  job 
would  reinforce  each  other. 

During  our  inquiry  into  avionics  training,  we  h, d an  opportunity 
to  observe  the  management  of  training  first  hand.  During  periods  of 
rapid  change,  it  is  all  too  easy  for  close  ties  between  training  and 
the  jof>  to  be  broken.  The  managemc'nt  procedures  devised  by  the  Air 
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’rraiiiiiiK  Comm.jiK)  lo  j-iisiirr  lhat  training  is  ri-spons  i vi*  to  tin*  iU‘(Mis 
of  tlie  fu'lil  somol  im«‘s  are  ineffective.  Thongti  tfiey  seem 
St  ra  i gilt  f orwa  r<f , they  ultimately  rely  largely  on  siilijective  judgment 
for  detailed  specification  and  implementation.  This  judgment  is 
generally  supplied  by  a relatively  small  group  of  people,  the  subject 
matter  specialists  at  the  technical  schools,  and  their  perceptions 
are  naturally  colored  by  the  school  environment. 

Although  there  are  many  points  at  which  other  Air  force 
agencies,  ami  other  echelons  of  ATC  itself,  can  participate,  both 
formally  and  informally,  in  the  management  of  training,  this 
participation  is  seldom  aggressive.  This  became  clear  as  we  traced 
in  detail  the  management  of  Bomb/Nav  avionics  maintenance  training. 
For  example,  the  Specialty  Training  Standard  is  written  by  ATC's 
subject  matter  specialists  and  approved  by  the  commands  that  use  the 
trained  personnel.  The  STS  is  crucial  because  it  is  the  document 
from  which  the  course  is  to  be  derived.  We  found,  however,  that 
tag's  approval  of  the  STS  was  perfunctory.  In  fact,  TAG  had  approved 
an  STS  that  required  TAG  technicians  to  be  tested  for  promotion  on 
SAG  equipment  (the  FB-111),  which  was  very  unlike  the  equipment  they 
had  been  working  on. 

We  found  similar  inconsistencies  in  the  evaluation  of  training. 
One  major  problem  is  that  ATG  asks  the  other  commands  to  evaluate 
graduates  on  the  basis  of  ATC  criteria  rather  than  on  those  of  the 
commands.  Moreover,  the  criteria  are  ambiguous.  Thus,  an  ATC  trip 
report  concluded  that  "not  enough  performance  training  is  given  in 
tech  school"  and  "most  graduates  interviewed  consider  the  l.owry 
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lours*'  iiiadi'iju.ili'  tor  iloiiiR  Itii'ir  joli,"  wliili*  <i  toinwil  A'l'C.  rovicw 
loncliidod  lli.it 


.ill  STS  Items  were  Iu'iiir  tuiigtit  to  tin*  lode  level  ^{iveti  i ii 
the  traiiiiiiK  stan<l.ir<l  ...  internal  review  ot  the  coiirs*-  did 
not  indii'.ite  anv  trainiiiK  <lef  iiii'iir  ies  otliiT  th.iii  down  tune 
of  training  eijii  i fiment . . . . Personnel  interviewed  ...  seemed 
to  indicate  that  tjie  graduate's  were  not  fully  tr.iined  on  .ill 
models....  This  is  .1  normal  condition  wtiere  tlu'  gr.Klu.ite.s 
may  tie  assigned  to  more  tlian  one  modi'l  airiratt.  Keiomniend 
...  (purchase  ol  ) selected  additional  tr.iiners. 


Our  study  highlights  three  areas  in  wtiicti  ttii'  management  ol 
training  can  he  improved.  First,  strengtlien  the  formal  pro<«'dur«'s 
referred  to  as  Instructional  System  Development  by  improving 
techniijues  for  task  analysis  and  field  evaluation.  Secoinl,  provide 
flexibility  by  changing  the  blanket  policy  tliat  initial  tr.iining 
should  prepare  airmen  for  career  advancement  to  one  that  permits 
training  to  be  tailored  to  the  needs  of  each  specialty.  Third, 
ensure  that  the  users  of  trained  personnel  are  active  partners  in 


training  management. 
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I.  INTKODDCTION 


THK  FRORI.KM 

Aircraft  witli  iiileRralol  avionics  syslrins  l>c-g.in  •■iil<-rin«  Air 
force-  opc-ratinn  units  with  the  f-IllA  in  I0h8.  Since-  tfie-n,  avionics 
packages  have  fiecome-  increasingly  sophist  icate-il  .iiul  ceimple-x, 

( 11  Imi  nat  i ng  witli  the-  Mark  II  package-  on  the  K-lllD.  Unfortunately,  as 
sophistication  increased,  both  reliability  an<l  the  ability  of  Air 
Force  personnel  to  maintain  the-  systems  decreased.  In  197.3,  there  was 
an  average  of  two  flying  hours  between  component  removals  for  the  total 
Mark  II  package.  Moreover,  about  28  percent  of  the  removed  components 
later  tested  OK  on  the  automatic  test  equipme-t .*  Such  frequent 
removals  generated  heavy  loads  on  maintenance  personnel  and  reduced 
rates  of  operational  readiness  to  unacceptable  values. 

ORIGIN  OF JTHE  STUDY 

This  study  was  initiated  at  the  request  of  the  Tactical  Air 
Command  (TAC)  for  a "disinterested  agency"  study  of  probl«-ms  with  the 
support  of  the  Mark  II  system  in  the  K-lllI).  TAC,  recognizing  the 
complex  nature  of  the  Mark  II  problem,  emphasized  c-xaminat ion  of 
personnel  and  training  support.  In  characterizing  previous  efforts, 

TAC  set  the  tone  for  the  present  study:  "to  date,  these  multiple 
problems  have  essentially  b(--n  addressc-d  individually,  as  separate 

^F-lllD  Mark  11  F iii_l_l  Isolation  Verification  Program  (FIVP), 
Progress  Report  No.  2,  General  Dynamics  Corporation,  Convair  Aerospace 
Division,  Fort  Worth,  Texas,  F7.M- 1 2-830 1 , April  8,  197A,  p.  lA. 
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fiUilies,  with  littU*  iii-<tpplh  consiilprat  loii  ot  llip  lomplcx 
interrfliit  ionships  which  exist  l)plwpoii  tliem."* 

Initial  Rand  ellorts  to  iileiitify  tlie  causes  ol  support  prohlems 
associated  with  th»*  Mark  II  in  the  K-lllD  hexan  with  orientation 
visits  to  the  tollowing  Air  Force  organ  i /.at  i oils  : Headquarters, 

Tactical  Air  Command;  the  Air  Training  Command's  Lowry  Technical 
Training  Center  (which  is  responsible  for  training  many  of  the 
personnel  who  maintain  the  F-lllD);  the  Military  Personnel  Center;  the 
Air  Staff  (l)PXOS,  DPPT,  and  LGYY);  the  T66th  Tactical  Fighter  Wing, 
Mountain  Home  Air  Force  Base,  Idaho  (F-lllF);  and  the  27tfi  Tactical 
Fighter  Wing,  Cannon  Air  Force  Base,  New  Mexico  (F- 11  ID) . Visits  to 
the  operational  bases  concentrated  on  the  Avionics  Maintenance 
Squadrons  (AMSs)  and  Field  Training  Detacliments  (FTDs). 

SCOPE  OF  THE  STUDY 

One  of  the  overriding  impressions  received  during  these  visits 
to  Air  Force  installations  was  the  broad  nature  of  the  support 
problem.  TAC  had  indicated  its  concern  about  the  Mark  II  in  the 
F-lllD,  but  we  found  that  the  problem  was  endemic  to  current 
integrated  avionics  systems,  to  the  maintenance  concept  as  applied,  and 
to  the  current  structure  of  the  integrated  maintenance  career  field 
(AFS  326).  Therefore,  we  could  expect  similar  problems  in  varying 

*Letter  and  attachment  from  Col.  V.  R.  Hol landsworth.  Director 
of  Maintenance  Engineering,  Headquarters,  Tactical  Air  Command, 

November  5,  1973. 

**Subsequent ly,  project  staff  have  visited  Edwards  (F-15),  Langley 
{F-15),  Nellis  (F-lllA),  and  Plattsburg  (FB-lllA)  Air  Force  Bases  and 
the  Miramar  Naval  Air  Station  (F-14),  as  well  as  the  F-16  Special 
Projects  Office. 
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(It'Rret's  ill  otliiT  airtrait  using  i iilt-gralcd  avioiiiis  systems.  in  tlie 
present  inventory,  this  irirliides  all  models  ol  the  K-Ill 
(K/FB-l  1 1A,1),F,K) , the  A-7D,  the  C-I30K,  the  C-'iA.  and  the  f-IS.  In 
the  future,  similar  problems  are  likely  to  he  seen  on  the  F-lli.  Air 
Force  experience  with  the  first  F-15  operational  unit  has  reinforced 
our  belief  that  the  problem  is  more  general  than  first  thought. 

Our  resi-arch  indicates  that  there  are  serious  problems  in  six 
interrelated  areas:  the  structure  of  the  integrated  avionics  lareer 
field;  the  manpower  system,  which  establishes  requirements  for 
maintenance  personnel;  the  personnel  ass i gnment /management  process, 
which,  working  with  gross  manpower  requirements,  translates 
authorizations  into  trained  and  experienced  personnel;  the  "what, 
where,  and  how”  of  formal,  on  the  job,  and  FTD  training;  the  logistics 
support,  which  provides  the  technical  environment  in  which  trained  and 
experienced  personnel  maintain  avionics  systems;  and,  of  course,  the 
reliability  of  the  hardware  and  software  that  make  up  advanced 
avionics  systems. 

PLAN  ^ THE  REPORT 

This  report  concentrates  on  formal  training  for  flight-line 
maintenance.  Following  the  introduction,  the  nature  of  integrated 
avionics  systems  and  the  career  field  and  training  structures  that 
support  their  maintenance  on  the  flight  line  are  described  in  Sec.  11. 
The  critical  first  step  in  evaluating  the  training  program  is  to 
establish  the  content  of  the  job  in  terms  of  the  skill  and  knowledge 
required;  this  is  described  in  Sec.  III.  Section  IV  contains  a 
detailed  analysis  of  the  current  training  program,  highlighting 
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fM\l ry- 1 eve  1 tr.uiiinKt  currj’iil  (>l.itis  lor  revision  ol  Ih.il  Ir.jiniiiK.  iiiol 
the  T.isk  Orifiili*il  Tr.iininx  program  that  TAC  rslah  1 i shod  al  Cannon  Air 
Force  Base.  Ne*xl , Sec.  V explores  an  allernalive  to  the  currt’iit 
training  system  haseil  upon  the  uniipie  nature  of  avionics  iii.i i nt enance , 
the  observed  shortcomings  of  the  current  system,  anil  previous  research 
on  effective  technical  training  systems.  The  need  tor  improvements  in 
procedures  for  designing  and  evaluating  training  programs  is  discussed 
in  Sec.  VI.  The  concluding  section  gives  recommendations  for  training 
content  and  management. 
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1 1 . BACKGKOUND 

TItK  INTKGRATKD  AVIONICS  MAINTKNANCK  CONCKPT 

Th«-  M.irk  II  is  the  prime  ex.imple  of  an  integrated  avionics 
system.  It  is  distinctly  different  from  earlier  systems,  although  it 
performs  tlie  same  functions  of  navigation,  flight  control, 
i ommiin  1 ( .1 1 1 ons  , .mil  weapon  control.  In  earlier  systems,  these 
functions  were  larried  out  by  separate  pieces  of  equipment,  each  with 
Its  own  sensors,  computational  devices,  and  displays.  The  first  and 
simplest  form  of  integration  combined  all  computational  requirements 
in  a singli'  executive-  computer.  With  the  advent  of  powerful  digital 
computers,  the  next  step  was  to  provide  separate  analog/digital 
converters  for  each  sensor.  The  Mark  11,  containing  a central  data 
converter  and  computer  complex,  is  at  the  frontier  of  current 
technology.* 

Maintenance  of  earlier  avionics  systems  focused  on  the  separate 
pieces  of  equipment.  lechnicians  worked  on  the  flight  line  where  they 
could  test  avionics  equipment  on  the  aircraft  and  perform  minor 
adjustments  and  repairs.  If  they  discovered  equipment  needing  major 
repair,  it  was  sent  to  the  intermediate  shop  where  it  was 
bench-checked  on  a "hot  mockup,"  an  operating  version  of  the  full 
avionics  system.  Equipment  that  could  not  be  repaired  in  the  shop  was 
sent  to  a depot  for  repair  or  disposal.  Personnel  in  the  same  career 
field  could  work  either  on  the  flight  line  or  in  the  shop,  although 

*See  Harry  I.  Davis,  "Military  Avionics--How  Much  Integration?" 
Astronautics  and  Aeronautics,  Vol  , 5,  No.  6,  .June  1967,  p.  !i3. 


(, 

t I I f^lil  - I I lie  I ('(  Inn  (' I .ms  IcikIimI  to  consiitct  .1  iiiovf  111(0  the  shop  <1 
promotion  li('(.ius<'  ot  its  Ki'oott'r  ilcni.mils  toi  toiliiiii.il  i ompotoiu  o .iinl 
its  tiottoi  working  i oinl  1 1 i oiis  . 

1 n t o){r  .1 1 0(1  .ivioniis  systoms  .iri'  siniil.irly  siipportod  hy  t ho  Air 
Korio’s  tliroo  lovols  ot  ni.i  1 lit  on.iiu  i'- - I 1 i ^lit  lino  (or  orK<)>>  1 /.it  1 on.i  I ) , 

1 lit  ormod  i .1 1 o stiop,  .in*)  ilopot  , ' To  t.uilit.ito  r.ipid  t n rn.i  round  , 
adv.inor'il  coniplox  .iviorns  systoms  .ire  dosiniiod  v 1 1 li  on-hoard  tost 
oipiipniont  lli.it  was  o r 1 >>  1 iii  I I y oxpoitoil  to  idontity  ina  I I iiiir  t i on  1 nx 
1 oiiiponont  s 'IS  poriont  o(  the  tinio  witlioiit  t ti<‘  tisr-  of  oxtorn.il 
I 1 i xi'l  - 1 1 ti«'  At'iF.  ( Ao  rosi'.ioo  (iroiind  Kijii  1 pinout  ) tost  sots.""'  In  addition, 
■ivioniis  tircnitry  is  lionsod  in  so.ilod  containors,  Lormod  l.ino 
kop  1 a(  cal)  I o Ifnits  (l.KlIs),  wliiili  oannol  ho  openod  on  tho  flight  lino. 
Soniolinios  roferrod  to  .is  "hlark  hoxos"  (although  thoy  aro  more'  olton 
gr.iy),  I.RUs  can  easily  tio  removi'il  from  tho  aircraft  and  roplacod  witli 
a work.ihlr'  spare. 

Kop. 11  r of  tlio  l.KU  is  the  jot)  of  the  iiitormodiato  ma  1 iitoiianco 
shop.  Using  tost  stations  tfiat  are  controlled  either  manually  or  tiy 
computer,  tho  circuitry  of  each  LRU  is  tested  independently  against 
predetermined  tolorance  limits,  a very  different  process  from  the  hot 
morkup  used  in  earlier  avionics  systems.  Test  stations  are  designed 

"'See  System  Specification  for  Air  (^ombat  Fijghter  Systems  2185 
(F-16A  and  F-16B),  General  Dynamics  Corporation,  Fort  Worth,  Texas, 
becember  16,  197^. 

iWfAFR  375-1  1 defines  oii-lioard  test  equipment  as  "An  avionics 
subsystem  designed  to  monitor,  analyze,  isolate,  display  and  record 
faults  in  aircraft  subsystem  performance.  This  system  can  display 
substandard  performance  and  malfunction  data  on  board  the  aircraft  and 
during  flight,  as  well  as  for  tfie  guidance  of  the  maintenance 
technician  on  the  ground."  Also  see  Carl  B.  Nichols,  Jr.,  Improving 
Kel iabi lity  and  Maintai^nabi 1 i ty  in  Avionics,  Professional  Report  No. 
A669 , The  Air  War  College,  The  Air  University,  Maxwell  Air  Force  Base, 
Alabama,  April  1972,  p.  23. 
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only  to  in.i  I I iiiu  I i on  I iiK  siihcompoiitMit  s or  Shop  Roplaceahle 

Units  (SRlIs),  nsn.illy  a lircnil  hoanl.  Intermediate  shop  technicians 
repair  l.RUs  hy  removing  and  replacing  t.inity  SRUs.  Malfunctioning 
SRUs  .ire  geiu-r.illy  sent  to  .1  depot  to  h«‘  repaired  or  thrown  away. 

in  sum,  m.iintenance  of  a<lvanced  avionics  systems  is  designed  to 
he  .u  (.  omp  I i s)ie<l  tfiroiigfi  tfiree  levels.  Avionics  systems  are  composed 
of  individii.il  I.RlJs ; faulty  l.RUs  are  identified  through  the  use  of 
on-hoard,  integrateil  test  eipiipment,  gener.illy  without  the  aid  of 
•'Xtern.il  flight-line  AUK.  Removed  l.RUs  are  tested  in  the 
1 ntermeif  1 .it e shop  on  test  stations  that  check  internal  circuitry 
against  predetermined  t o 1 ranees . Shop  action  is  limited  to  the 
removal  .ind  replacement  of  SRUs,  whose  repair  is  the  responsibility  of 
the  ifepot  . 

THE  OCCUPATIONAL  CONCEPT--THE  326  CAREER  FIELD 

To  support  the  new  maintenance  concepts  of  tlie  F-lll,  the  Air 
Force  put  flight-line'  and  shop  personnel  in  separate  career  fields.* 
During  the  period  of  this  study,  these-  career  fields  had  the  structure 
shown  in  Table  1,  although  the  structure  has  been  changing  since  the 
advent  of  integrated  avionics  systems.  A brief  description  of  these 
changes  reveals  the  fluidity  of  the  situation. 

Originally  flight-line  and  shop  personnel  were  separated  by 
designating  the  traditional  avionics  and  communication-electronics  Air 
Force  Specialty  Coiles  (AFSCs)  with  a "V"  prefix  for  shop  maintenance 
and  a "U"  for  flight-line  maintenance.  In  1968,  the  Air  Force 

*AFM  66-1,  Vol.  V,  puts  these  responsibilities  in  separate  shops 
in  the  F-lll  Avionics  Maintenance  Sipiadrons. 
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T.it)l»-  1 

SI'RUCTUKK  OK  I N IKOKATKI)  AVIONICS  MAINTKNANCK  CAKKKK 
HKI.DS,  \'n^ 


U) 

1 Avioiiits  Systems  Spec  i a I i sLs/Terhn  i f i atis 

( FI  1 Kill -l.i  rie  Maintenance  Only) 


Eciiiipment  Spec^lty 

Weapons  cont ro 1 / i nerl i a 1 navigation  AFS  326X2A 

("Bornh/Nav") 

Automatic  flight  cont ro] / i ns t rument s AFS  326X2B 

("  1 ns  t rument /All  topi  lot " ) 

Communications/navigation/penetration  AFS  326X2C 

aids  ( "Comm/KCM" ) 


(b) 

Integrated  Avionics  Component  Specialists/Technicians 
(Intermediate  Shop  Maintenance  Only) 


Eipiijjment  jm^J^unct^oji 
Automatic  test  station  operator 
Manual  test  station  operator 


Specia 1 ty 
AFS  326X1A 
AFS  326X1B 


Aerospace  ground  equipment  repairman 


AFS  326X0 
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I'sl  ab  1 i sill'll  .1  iH'w  AKSC  to  troubleshoot,  repair,  aiul  calibrate  all 
1-1 11  Category  II  AGK , including  test  stations.  Selected  personnel 
1 rom  each  "V"  prelixi'd  AFSC  received  convorcion  training,  became 
Avionics  Aerospace  Ground  Kquipment  Specialists/Technicians,  and  were 
awarded  .i  126X0  AFSC.  In  1970,  a further  conversion  consolidated  the 
"V"  prefixed  AFSCs . After  conveisiori  training,  airmen  were 
reclassified  as  Integrated  Avionics  Component  Special ists/Technicians 
and  awarded  either  a 326X1A  or  326X1B  AFSC.  The  A "shred"*  was 
responsible  for  testing  navigation/flight  and  weapon  control  and 
flight  data  recorder  systems  (usually  on  computer-controlled  or 
"automatic"  test  stations.)  The  B shred  was  responsible  for  testing 
commuriication/mission,  traffic  control,  and  penetration  aids  on 
"manual"  test  stations.  While  not  responsible  for  the  maintenance  of 
the  test  station,  the  "Xls"  are  responsible  for  its  operation.  Their 
major  functions  are  the  test,  troubleshooting,  repair,  and  alignment 
of  LRUs.**  In  1975,  a further  shred  realigned  the  shop  AFSCs. 

The  consolidation  of  shop  AFSCs  prompted  similar  action  for  the 
flight  line  two  years  later.  In  January  1972,  the  flight-line  AFSCs 
were  realigned  as  326X2A,B,C--Integrated  Avionics  Systems 
Specialists/Technicians.  The  A shred  is  responsible  for  bombing, 
navigation,  and  fire  control  systems,  digital  computers,  and 
multi-sensor  displays.  The  B shred  is  responsible  for  flight  control 
and  integrated/mechanical  instruments.  The  C shred  is  responsible  for 
communication,  navigation,  and  electronic  countermeasure  systems. 

*A  "shred"  is  a division  of  a career  field;  it  is  indicated  by  a 
letter  suffix. 

**See  AFM  39-1,  Airman  Classification  Manual. 
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The  range  ot  resptiiisihi  1 i ly  ol  the  .i'/fi  l areer  lu-lil  is  shown  in 
Table  2.  Terhnirians  in  AFSC  .i2(j  <ire  r«’spons  i h 1 e for  .i  large  mimtier 
of  systems;  furthermore,  the  systems  are  hoiiseil  in  a large  numfier  of 
aircraft  types.  The  range  will  fie  substantially  increased  when  tfie 
F-16  and  B- 1 join  the  active  inventory. 

CAREER  PROGRESSION 

Progression  in  AFSC  career  field  T26  is  consistent  witfi  the 
general  Air  Force  pattern.  An  airman  progresses  in  a dual  skill  levi-l 
and  grade  system  within  his  AFSC.  The  key  to  progression  in  both 
tracks  is  the  Specialty  Training  Standard  (ST.S).  Air  Force  Regulation 
8-13  notes,  "An  STS  outlines  the  training  required  to  achieve  a skill 
level(s)  within  an  Air  Force  Specialty  (AFS).  Througti  its  use,  the 
individual  training  of  airmen  is  standardized  and  tlie  quality  of 
training  controlled." 

In  general,  an  airman  in  any  of  the  six  326  AFSCs  progresses  from 
the  "1”  or  helper  level,  to  the  "3"  or  apprentice  level,  through  the 
"5"  or  specialist  level,  to  the  "7"  or  technician  level,  without 
leaving  the  AFSC.  The  six  326  AFSCs  funnel  into  a common  "9"  or 
superintendent  level.  Thus  a man  in  a 326  flight- line  shop  looks 
forward  to  a career  on  the  flight  line,  unlike  his  counterparts  who 
work  on  less  advancefl  avionics.  Other  avionics  AFSs  (such  as  322X1Q 
for  the  F-4E)  encompass  both  organizational  and  inlermeiliate  level 
maintenance,  and  there  is  appreciable  circulation  of  personnel  between 
tfie  two  levels  tioth  as  they  perform  day-to-day  maintenance  tasks  and 
as  they  progress  in  their  careers. 


AFSC  326  CAREER  FIELD  RESPDNS  I B I I.I  T I ES 


1 I 
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Airmen  are  awarded  their  d-level  after  they  complete  basic 
lechtiiral  trainiiiR.  It  is  Air  Force  policy  that  3-levels  (and  helow) 
must  work  under  direct  supervision  unless  the  specific  task  they  are 
performing  has  been  "signed  off"  in  their  STS.  Similarly,  at  least  a 
7-skill  level  is  required  for  an  airman  to  be  designated  a production 
inspector.*  Advancement  to  the  5-level  reipiires  demonstration  of 
proficiency  and  knowledge  of  specific  tasks,  as  specified  in  the  STS. 
The  STS  also  requires  the  completion  of  prerequisite  Career 
Development  Courses  (CDCs)  before  skill  advancement. 

Grade  promotion  is  also  tied  to  skill  advancement  as  set  out  in 
the  STS.  The  Specialty  Knowledge  Test  (SKT)  is  an  important  part  (22 
percent)  of  the  Weighted  Airman  Promotion  System.  Questions  on  the 
test  for  promotion  to  E-5  are  based  on  "5-skill  level"  knowledge  as 
defined  by  the  CDC  and  the  STS.  Promotions  to  E-6  and  E-7  are  based 
on  "7-skill  level"  knowledge.  The  relation  of  the  skill  levels  and 
grades  is  shown  in  Table  3.  Progress  in  skill  level  always  precedes 
(but  does  not  automatically  cause)  progress  in  grade. 

The  STS  establishes  proficiency  required  at  the  3-,  5-,  and 
7-skill  levels  in  subject  knowledge,  task  knowledge,  and  task 
performance.  Table  U shows  the  general  proficiency  level  in  each  of 
the  areas  and  for  each  skill  level.  The  terms  "task  performance"  and 
"task  knowledge"  obviously  are  keyed  to  a specific  task,  whereas  the 
term  "subject  knowledge"  refers  to  knowledge  that  is  related  to  more 
than  one  task  in  the  specialty  or  that  provides  a general 
understanding  of  the  specialty. 


*See  AFM  66-1,  Vol.  5,  pp.  2-2  and  3-2. 
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Hr.Kir 
K-2 
K-  $ 
K-4 

K-S 

K-6 

K-7 

E-8 

E-9 


Tab  If  ! 

CKIlEh'lA  FOR  FROMOTION 


Criteria 

Four  moiiLlis  time  in  K^ade  with  satisfactory  performance. 

Eight  montlis  time  in  grade  with  satisfactory  performance. 

Eight  months  time  in  grade;  one  year  time  in  service; 
satisfactory  performance.  In  addition,  the  5-skill  level 
miKst  have  been  obtained  by  the  first  day  of  the  montfi 
preceding  the  month  in  which  the  promotion  will  be 
effective.  Currently,  the  planned  promotion  "phase  point" 
for  E-4  is  51  months  time  in  service.  Promotions  are 
.iwarded  as  vacancies  occur. 

Twelve  months  time  in  grade  and  three  years  time  in  service". 
Must  have  5-skill  level. 

Eighteen  months  time  in  grade  and  five  years  time  in 
service.  Must  have  7-skill  level.  Promotion  is  governed  by 
the  Weighted  Airman  Promotion  System. 

Twenty-four  months  time  in  grade  and  eight  years  time  in 
service.  Must  have  at  least  7-skill  level.  Promotion 
governed  by  the  Weighted  Airman  Promotion  System. 

Twenty-four  months  time  in  grade  and  11  years  time  in 
service.  Either  7-  or  9-skill  level.  Must  qualify  under 
the  USAF  Supervisory  Examination.  Promotion  determined  by 
boa  rd . 

Twenty-four  months  time  in  grade  and  14  years  time  in 
service.  Must  have  9-skill  level.  Promotion  determined  by 
board . 


u 

Table  U 

AVKKAGK  STS  KKQIJ 1 HKMKNTS 


Ski  1 1 

Level  Area  Proficiency  I.evel 


) Subject  knowledge  Can  explain  relationships  of  basic  facts 

and  slate  principles.  (Principles) 

Task  knowledge  Can  determine  step-by-step  procedures 

for  doing  task.  (Procedures) 

Task  |)erl  orni.ince  Can  do  most  parts  of  the  task.  Needs 

help  only  on  hardest  parts.  May  not 
meet  local  demands  for  speed  or 
accuracy.  (Partially  proficient) 

S Subject  knowledge  Can  analyze  facts  and  principles  and 

draw  conclusions  about  the  subject. 
(Analys^) 

Task  knowledge  Can  explain  why  and  when  the  task  must 

be  done  and  why  each  step  is  needed. 

( Ope y t i n^  pri ncip 1 e s ) 

Task  performance  Can  do  all  parts  of  the  task.  Needs 

only  a spot-check  of  completed  work. 
Meets  minimum  local  demands  for  speed 
and  accuracy.  (Competent ) 
a 

7 Subject  knowledge  Analysis 

a 

Task  knowledge  Operating  principles 

Task  performance  Can  do  the  complete  task  quickly  and 

accurately.  Can  tell  and  show  others 
how  to  do  the  task.  (Highly  proficient) 

a 

The  STS  format  provides  for  higher  levels  of  proficiency 
in  subject  and  task  knowledge,  but  they  are  not  required  of  326 
lechn i c i ans . 
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TRAINING  IN  THK  12<.  CARKKR  FlKl.l) 

Tlu-  i tit  oral  t toil  of  tho  326  AKS  with  its  supporting  training 
program  is  illustratod  in  Fig.  1.  Training  gonorally  consists  of 
formal  classroom  instruction  at  one  of  tho  Air  Training  Command's 
rosidential  tochnical  training  centers  and  on  the  job  training  in  an 
operational  unit.  After  receiving  basic  military  training,  an  airman 
assigned  to  the  326  AFS  is  sent  to  technical  school  for  formal  3-level 
training.  After  graduation  and  assignment  to  an  operational  unit,  he 
enters  the  OJT  program.  "On-the-job  training  is  a planned  training 
program  designed  to  qualify  airmen,  through  self-study  and  supervised 
instruction,  to  perform  in  a given  Air  Force  Specialty  (AFS)  while 
actually  working  in  a duty  assignment  of  the  AFS."*  On  the  job 
training  in  the  326  AFS  consists  of  basic  knowledge  instruction 
through  the  Career  Development  Course  (a  correspondence  course),  and 
proficiency  training  conducted  by  unit  personnel.  Field  Training 
Detachment  courses  may  augment  the  OJT  program. 

^sic  Technical  Training 

After  completing  basic  military  training,  an  airman  enters  basic 
technical  training  at  one  of  the  technical  centers  of  the  Air  Training 
Command.  This  training  is  often  referred  to  as  3-level  training 
because  the  airman  is  awarded  his  3-level  on  successful  completion. 

It  usually  consists  of  classroom  and  laboratory  instruction  and 
typically  progresses  from  instruction  in  general  theory  to  instruction 
relevant  to  specific  equipment  and  to  the  development  of  skills  in 
using  or  repairing  that  equipment. 

*See  AFR  50-26  and  AFM  50-23,  Guide  for  Planning  and  Conducting 
On- the- Job  Training,  p.  l-I. 


1<) 


Pig.l  — Relation  between  skill  levels  and  training  program 
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As  T;il)l<-  U shows,  typically  the  3-l<'Vcl  Icihnical  school  Kra<luat(‘ 
IS  siipposcil  to  he  able  lo  'Mo  most  parts  of  the  task,"  as  specified  in 
the  S'IS . He  "needs  help  only  on  hardest  parts,"  hut  "may  not  mec-t 
local  demands  lor  speed  or  accuracy."  He  should  he  .ihle  to  "determine- 
step-hy-step  procedures  lor  doing  the  task"  and  "explain  relationships 
of  basic  tacts  and  state  ge-neral  principles  about  the  suh)i'ct." 

The  Air  Force-  devote-s  more  resources  to  )-le-ve-l  training  than  to 
any  other  training  it  conducts.  This  training  provide-s  a scre-ening 
function  by  e- 1 im  i nat  i ng  men  who  cannot  or  will  not  accjiiire-  the 
technical  knowledge  needed  for  the  job.  It  is  ofte-n  the  only  formal 
(and  therefore-  controllable  and  observable)  training  a man  receives; 
once  a man  is  assigned  to  an  operating  command,  it  is  ofte-n  difficult 
to  interrupt  his  productive  time  with  further  training.  Thus,  because 
the  basic  technical  course  so  often  provides  the  only  structured 
opportunity  a man  has  to  obtain  technical  knowledge,  ATC  holds  that 
the  course  must  expose  everyone  in  the  career  field  to  the  full  range 
of  subjects  they  may  need  to  know,  wherever  they  may  be  assigned. 

With  the  exception  of  training  for  AFSC  32632C,  all  3-level 
technical  training  is  conducted  at  one  of  the  resident  centers.  As  of 
the  beginning  of  1975,  with  the  exception  of  the  326X2B  and  C fields, 
basic  technical  training  in  the  326XXX  fields  was  conducted  at  Lowry 
Technical  Training  Center.  The  complete  list  of  centers  responsible 
for  326XXX  courses  is  given  in  Table  5.  The  first  part  of  training 
for  the  C shred,  basic  electronics  and  communications,  is  taught  at 
Keesler  Air  Force  Base.  The  second  part  is  taught  in  the  FTBs  located 
at  the  various  F/FB-111  operating  bases.  Students  taking  these 
courses  are  still  assigned  to  the  Air  Training  Command  (as  indicated 
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by  their  2-level  sLaliiu),  not  to  an  Avionics  Maintenance  St|iiailron. 
Alter  graduation  from  the  KTl)  course,  the  new  J2632C  apprentice  is 
assigned  to  an  AMS  at  the  same  or  another  base. 


Table  S 

126  AFS  TFXHNICAL  CENTERS 


AFSC 

Technical  Center 

a 

32630 

Lowry  AFB,  Denver,  Colorado 

a 

32631A 

Lowry  AFB 

a 

32631B 

Lowry  AFB 

a 

32632A 

Lowry  AFB 

32632B 

Chanute  AFB,  Rantoul , 

Illinois 

32622C 

Keesler  AFB,  Biloxi, 

Mississippi 

32632C 

FTDs  at  Mountain  Home 
and  Plattsburg  AFBs 

, Cannon,  Nellis, 

a 

Under  revision  as  of  first  writing  (November 

1975). 


As  in  other  electronics  specialties,  technical  training  in  the 
126  AFS  is  divided  into  two  parts.  The  first  part  consists  of  basic 
or  fundamental  electronics;  and  the  second  concerns  the  specific 


systems  that  men  in  the  eareer  I i e I il  are  responsible  for. 
shows  the  m.ijor  topics  in  th»‘  basic  e 1 ec  l ron  i i s loiirs*-  lor  each  field 
before  mi<l  l')7f).  Airmen  assigned  to  intermedi.ite  maintenance  shops 
(XO,  XIA,  and  XIBJ  take  the  same  ;jOO-hoiir  (IO-w<‘pk)  course.  All  basic 
electronics  courses  in  the  technical  centc-rs  arc-  taught  by  sc-lf-paced 
instruction  (with  recent  exceptions,  as  discussed  later). 

After  they  have  passed  electronics  fundamentals,  airmen  arc- 
trained  in  "set  school"  on  ecpiipment  associated  with  their  AFSC . 

Table  7 shows  the  former  equipment-oriented  training  in  the  32bXXX 
AFSCs.  Also  shown  in  Table  7 are  the  particular  models  of  F-111  to 
which  the  training  was  oriented.  Training  was  not  given  on  all  models 
of  the  K-111  because  ATC  was  unable  to  purchase-  all  of  the  c-quipme-nt 
found  in  the  various  F- 1 1 1 models.  For  example,  the  F-lllA  and  F 
models  have  no  signal  converter  unit;  the  FB,  D,  and  F models  each 
have  a different  converter  set;  and  there  are  four  different  terrain 
following  radar  (TFR)  sets  on  the  five  F- 11 1 models.  To  cope  with 
this  problem,  ATC  adopted  a "representative  training  concept,"  that 
is,  they  made  the  equipment  they  had  represent  other  equipment  in  the 
career  field  by  emphasizing  features  that  were  similar  on  the  various 
models.  The  Specialty  Training  Standard,  and  thus  the  Career 
Development  Course  and  Specialty  Knowledge  Test,  reflected  the 
representative  training  concept  by  stressing  systems  and  tasks 
specific  to  the  equipment  available  at  Lowry  AFB  and  by  referring  to 
the  technical  orders  associated  with  that  equipment. 

The  deficiencies  of  representative  training  for  326X2A  AFSC  were 
evident  almost  from  the  outset.  Action  was  taken  in  late  197A  to 
remedy  these  deficiencies  after  TAC  had  initiated  a series  of  special 
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Table  ft 

COURSK  HOURS  FOR  BASIC  ELECTRONICS  IN  J2ft  AFS 


inter- 
ned iate 
Shops 

FI  ight-l 

1 inc 

r 

Major  Topics 

-32A 

-32C 

Or ientat  ion 

2 

2 

1 

4 

3 

Safety  and  First  Aid 

) 

2 

2 

) ^ 

Structure  of  Matter 

1.5 

1.5 

' ^ 2 

Theory  of  Electron  Flow 

1 

1 

Schematic  Symbols 

2 

2 

2 

Power  of  Ten  and  Metric  Conversion 

4 

4 

4 

; 

Soldering  Techniques  and  Printed  Circuit 

2 

— 

— 

h 

Resistance  and  PSM  6 Ohm  Meter 

6 

6 

10 

DC  Ohm's  Law  and  Power  Law 

8 

8 

i)  ^ 

Series  Circuits 

5 

5 

1 

Parallel  Circuits 

6 

ft 

10 

Series/Parallel  Circuits 

Voltage  and  Current  Dividers 

ft 

3.5 

6 

3.5 

) 

Bridge  Circuits 

4 

— 

2 

— 

Magnetism  and  DC  Meters 

4 

1 4 

1 3 

3 

Principles  of  Ceneration  and  Alternating  Current 

4.5 

1 4.5 

1 9 

8 

Capacitance 

— 

— 

5 

— 

Vacuum  Tube  Voltmeter  Operation 

5 

5 

1 — 

— 

Oscilloscope  Operation 

6 

ft 

B 

ft 

Electromagnetism  and  Relays 

4 

4 

— 

Reactance  and  Reactive  Circiiits 

9 

9 

— 

Series  and  Parallel  Impedance 

10 

— 

— 

Resonance 

10.5 

— 

— 

— 

DC  Motors 

4 

4 

4 

— 

AC  Motors 

4 

4 

5 

— 

Vacinim  Tubes  and  Tube  Testing 

— 

6 

— 

— 

Solid  State  Theory 

i 

7 

6 

— 

Principles  of  Transistors 

9 

6 

12 

8 

Transistor  Testing 

3.5 

— 

— 

— 

Four  Layer  Devices 

5 1 

— 

B 

— 

Photosensitive  Devices 

3 1 

— 

— 

Transformers 

2 1 

2 

3 

Transients  and  Time  Constants 

3 1 

— 

— 

Integrators 

2 1 

— 

B 

— 

D1  f f erentlators 

2 

— 

— 

— 

Rect if lers 

3.5 

3.5 

3 

— 

Filters 

4 

4 

— 

— 

Voltage  Doublers 

3 

— 

— 

— 

"Regulated  Power  Supplies  and  Zener  Diodes 

5 

5 

3 

3 

Silicon  Controlled  Rectifiers 

2 

— 

— 

— 

Trcjubleshoot  ing  Fundamentals 

3 

— 

— 

— 

Basic  Amplifier  Configuration  1 

6 

ft 

8 

3 

Audio  Amplifier 

7 

-- 

— 

— 

Video  Amplifier 

4 

4 

— 

— 

Push-Pull  Amplifiers 

5 

— 

— 

— 
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I T;U)  1 e (i  ((-(in  t i mu'cl ) 


1 

Major  Topics 

inter- 

FI ight-1 ine 

Shops 

-32A 

-32B 

-32C 

Kioiil  Effect  Transistors 

i.5 

4 

Unijunction  Transistors 

T 

— 

— 

— 

Servo  Control  Systems 

— 

4 j 

2 

3 

Kasic  Oscillator  Principles 

S 

5 

5 

3 
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surveys,  conf erenres , and  studies  (including  the  study  on  which  this 
report  is  based).  A major  consequence  of  these  activities  was  that 
ATC  moved  set  school  to  the  PTDs  at  the  operating  bases.* 

On  the  Job  Training 

Upon  graduation  from  set  school,  the  airman  is  assigned  to  an 

Avionics  Maintenance  Squadron  at  an  operating  base,  where  he  is 

supposed  to  enter  the  OJT  program.  The  Air  Force  views  OJT  as  "a 
systematic,  reportable  application  of  self-study  and  craftsman- 
apprentice  principle.  The  trainee  acquires  AFS  knowledge  by  enrolling 
in  and  studying  Career  Development  Courses;  he  acquires  job  proficiency 
while  performing  on  the  job  under  supervision  of  a skilled  worker."** 

The  Career  Development  Course  is  the  self-study  portion  of  OJT. 

When  the  airman  enters  the  OJT  program  he  receives  the  first  of  the 

CDC  packages,  usually  prepared  in  volumes  of  related  topics,  and 
studies  it  on  his  own.  When  he  feels  he  is  ready,  he  takes  a Course 
Examination  to  test  his  mastery  of  the  subject  matter.  Generally 
there  is  a time  limit  beyond  which  he  should  not  wait  to  take  the 
examination . 

The  CDCs  in  a given  field  are  written  in  the  curriculum  units  at 
the  technical  centers  that  provide  the  basic  technical  course  in  the 
field.  Thus,  they  tend  to  reflect  much  of  the  material  of  the  basic 
course  and  are  geared  to  the  STS.  The  review,  publishing,  and 
distribution  of  the  CDCs  and  processing  of  the  examinations  are 
administered  by  the  Extension  Course  Institute  of  the  Air  University. 

*This  change  is  addressed  in  more  detail  in  Sec.  IV. 

*i^'AFM  50-23,  Guide  for  Planning  and  Conducting  On-the-Job 
Training,  p.  1-2.  See  also  AFR  50-26. 


It  ('DCs  art*  not  available,  the  slinly  references  listed  in  the  STS 
provide  materials  for  career  knowleilge  training."'  They  are  generally 
Air  Force  Manuals  and  tedinical  orders.  Completion  of  stinfy  of  the 
references  is  docnniented  on  the  man's  personal  < o{)y  of  the  STS.  The 
ld)Cs  for  326X2A  and  !)26X2B  became  available  in  April  1974  and  for 
12bX2C  in  July  1974. In  either  case,  the  STS  jilays  a major  role  in 
defining  the  content  of  tfie  knowledge  aspects  of  the  OJT  program.  The 
result  was  that  in  the  J26  AFS , the  CDC  reflected  the  representative 
training  concept  devised  at  Lowry  AFB  and  was  tied  to  the  particular 
models  of  F-111  for  which  Lowry  AFB  had  training  (‘ijiiipment . 

I’aralleling  the  self-study  program,  job  proficiency  training  is 
carrieil  out  in  each  operational  unit."""  The  new  3-level  is  assigned  to 
a more  experienced  person,  usually  a 5-level,  who  is  responsible  for 
training  him  to  perform  tasks  to  the  proficiency  specified  in  the  STS 
for  the  5-lev«'l.  The  Air  Force  stresses  that  the  essential  feature  of 
this  procedure  is  "tfie  close  association  between  the  trainee  and  the 
t ra  i lie  r . 

On  each  man’s  personal  copy  of  the  STS  are  recorded  the  dates  he 
began  and  satisfactorily  completed  training  for  each  task  listed  in 
tfie  STS.  Wfien  fiis  trainer  believes  he  has  mastered  a given  task  to 
the  degr«-e  of  competence  indicated  in  the  STS,  the  3-level  is  checked 
out  by  his  supervisor  and,  if  satisfactory,  the  task  is  signed  off  in 

■"AFM  50-23,  Guide  for  Planning  and  Conducting  On-th^-Job 
Training,  p.  7-3. 

**KC I Catalog  an<f  Guide  for  Extension  Course  Administration, 
Extension  Course  Institute,  Air  University,  Gunter  AFB,  Alabama, 

October  1,  1974. 

*''c*See  AFM  66-1,  Vol  . V,  pp.  1-3. 

****AFM  50-23,  Guide  for  Planning  and  Conducting  On-the-Job 
Training,  p . I - 10 . 


2^ 


his  STS.  Befort'  a task  is  signed  oil,  llu'  T-li'vel  may  not 

perform  it  wilfioul  supervision  liy  a S-level  or  liiRli«>r.  In  addition,  a 
man  cannot  he  upgradeil  to  S-level  until  all  tasks  he  is  working  on 
have  been  signed  off  in  the  STS. 

Field  Trainiii^  Detachment  Courses 

ATC  also  operates  about  70  FTDs , which  work  with  the  operating 
commands  to  update  maintenance  crews  when  new  equipment  is  phased  into 
the  field  and  to  provide  other  on-site  training  support."  The  FTDs 
are  controlled  by  Sheppard  Technical  Center,  but  a large  part  of  their 
established  syllabus  originates  in  the  FTD  itself  and  is  reviewed  by 
the  curriculum  units  of  the  Technical  Training  Centers  that  teach  the 
basic  courses  in  the  specialties  concerned.  The  FTDs  also  devise 
courses  to  fill  on-site  needs  for  such  special  skills  as  microminiature 
soldering.  Satisfactory  completion  of  courses  in  the  established  FTD 
syllabus  often  earns  an  airman  cred.t  in  the  Community  College  of  the 
Air  Force. 

Table  8 shows  the  established  FTD  courses  that  support  the  ,326 
AFS.  There  are  no  FTD  courses  for  the  intermediate  and  AGE 
maintenance  shops  because  the  test  stations  that  would  be  required  to 
support  such  courses  are  considered  too  expensive  to  be  dedicated  to 
FTD  use.  There  is  justification  for  this  viewpoint,  since  FTDs 
typically  train  very  few  students  at  any  one  time  in  a given  specially 
so  that  test  stations  dedicated  to  training  might  be  unacceptably 
underuti 1 ized . 

*See  ATM  50-29,  Fjeld  Training  Program. 
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It  may  be  noted  that  the  Strategic  Air  Command  lias  a much  more 
intensive  FTI)  program  than  does  TAC.  For  I'xample,  SAC ' s FTDs  offer 
about  500  hours  in  FB-lllA  training  for  the  326X2A  field,  whereas  the 
course  at  Cannon  AFB  for  the  F-lllI)  (a  more  complex  aircraft)  covers 
the  same  material  in  168  hours. 

Table  8 does  not  show  the  many  ad  hoc  and  site-specific  courses 
offered  by  the  FTDs  to  meet  special  needs.  These  courses  are  not  part 
of  the  established  syllabus,  and  their  existence  often  depends  on  the 
aptitudes  of  particular  FTD  instructors  as  well  as  on  special  site 
needs . 

Finally,  the  established  FTD  courses  are  denoted  as  7-level 
courses,  implying  that  they  are  intended  to  contribute  to  a 5-level's 
upgrading.  in  fact,  however,  most  3-levels  enter  the  F'TD  course  (if 
one  exists)  shortly  after  they  arrive  on  base  rather  than  starting  on 
OJT.  This  may  be  because  the  representative  training  at  Lowry  AFB  is 
unable  to  deal  with  important  differences  among  the  F-111  models. 
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III.  UKVKLOPING  THK  KKglJ I RKMENTS  F()R  TRAINING 

B«*cause  tin'  F-lll  re<iiiir('i1  smli  a radical  departure  from  the 
previous  procedures  for  maiutaining  avionies  systems,  and  to  ascertain 
the  reipji rement s for  training,  we  undertook  several  efforts  to 
understand  the  joh  of  maintaining  this  new  generation  of  avionics 
e(4Ui pment . 

PROCEDURES  FOR  SURVEYING  JOB  CONTENT* 

A unique  data  collectioc\  effort  was  required  to  establish  the 
content  of  the  job.  Occupational  surveys  were  not  available  for 
avionics  flight-line  maintenance  (the  first  flight-line  job 
inventories  for  the  326X2A  and  .326X2B  occupations  were  published 
in  April  1976).  Of  the  several  ways  for  gathering  job-related 
inform3tion--occupational  survey,  questionnaire,  checklist, 
individual  interview,  and  observation  interview**--the  Air  Force 
rates  the  observation  interview  highest  in  terms  of  the  specificity, 
completeness,  and  accuracy  of  the  information  obtained.  "Of  the 
methods  described,  the  observation  interview  is  preferred  because  it 
reveals  unique  tasks  and  pro^jjdes  a better  understanding  of  the  work 
pe r f o rmed . "***  In  many  cases,  this  better  understanding  consists  of 

*The  work  on  which  this  section  is  based  is  reported  in  detail  in 
Analyses  of  the  Content  of  Advanced  Avionics  Maintenance  Jobs,  by 
Polly  Carpenter-Huf fman , John  Neufer,  and  Bernard  Rostker,  R-2017-AF, 
The  Rand  Corporation. 

■•’f*See  AFM  50-2.  An  observation  interview  is  conducted  at  the 
work  site  and  concerns  current  work. 

***AFM  50-2,  p.  28  (emphasis  added). 
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interview  because  of  the  potential  variety  of  possibilities  and 
because  of  the  disinclination  of  most  job  incumbents  for  writing 
accurate*  descriptions  of  any  length.  As  a result,  we  used  observation 
interviews  in  our  job  content  survey. 

Tbe  Survey  Population 

The  job  content  survey  examined  maintenance  as  carried  out  by  the 
three  Avionics  Maintenance  Squadron  flight-line  shops.  Normally 
pt'rsonnel  from  one  of  the  three  shops  are  dispatched  to  correct  a 
system  malfunction,  which  is  reported  by  aircrews  during  the 
post-flight  debriefing.  An  effort  is  generally  made  to  let  a 3-level 
airman  work  with  a 5-level  for  OJT . 

To  facilitate  rapid  maintenance  action  before  an  aircraft  launch 
or  immediately  after  an  aircraft  lands  (while  power  is  still  applied 
to  the  various  avionics  systems),  a special  multi-shop  team  was 
established.  At  Cannon  AFB,  this  team  is  referred  to  as 
"Roadrunner . The  Roadrunner  team,  stationed  on  the  flight  line,  has 
its  own  truck,  carries  its  own  spare  LRU  parts,  and  is  made  up  of 
experienced  personnel  from  each  shop.  Roadrunner  duty  places  greater 
stress  on  treating  the  avionics  system  as  an  integrated  whole  and 
quick  turnaround  action  than  does  a conventional  shop.  Jobs  performed 
by  the  Roadrunner  team  were  also  included  in  the  survey. 

'^''At  Mountain  Home  AFR,  the  team  is  known  as  Big  D,  the  I)  standing 
for  diagnostic.  At  Plattsbiirg  AFB,  the  team  is  called  the  Big  Apple. 


Survey  Procedures 

During  initial  development  ol  survey  procedures,  it  soon  became 
apparent  that,  in  order  not  to  disturb  normal  work  patterns  and  to 
maximize  the  number  of  cases  an  interviewer  could  efficiently  handle, 
the  best  approach  was  to  debrief  the  maintenance  team  immediately 
after  completion  of  a .job.  These  interviews  were  conducted  at  Cannon 
AFfi  during  the  first  two  weeks  of  April  1975.  Immediately  after 
completing  a maintenance  assignment  and  the  required  349  form,  the 
maintenance  crew  joined  the  interviewer  in  a room  adjacent  to  the 
flight- line  shops.  The  interviewer  copied  the  349  data  and  indicated 
his  desire  to  know,  step  by  step,  how  the  crew  performed  the 
assignment  just  completed.  The  "flow  chart"  nature  of  the  survey  form 
enabled  the  interviewer  to  record  the  logical  decision/activity 
process.  The  activity  sequence  was  drawn  out  by  asking  such  questions 
as ; 


What  did  you  do  first?  Why? 

What  did  you  do  next?  Why? 

Have  you  left  out  any  steps? 

Did  that  complete  the  job? 

After  we  obtained  the  sequence  of  steps  from  start  to  finish,  we  asked 
the  interviewee,  at  each  step,  whether  he  used  technical  orders  and 
where  he  learned  to  choose  and  perform  that  step. 

During  the  interview  period,  April  1 through  April  11,  1975,  we 
completed  I4l  interviews.  Since  some  maintenance  assignments 
consisted  of  more  than  one  job  action,  the  interviews  yielded  188  AFTO 
349  jt>b  pntrie8--96  from  Bomb/Nav,  42  from  Instrument/Autopilot,  and 


n 


so  from  Cnmm/ECM.  (We  assigned  each  Roadrnnner  job  to  the  shop 
mi^intaining  the  affected  system.) 

f 

f Revi  ew 

In  May  1975,  a Rand  team  revisited  Cannon  AFB  to  validate  the 
field  observations.  One  or  more  experienced  maintenance  men  from  the 
appropriate  shop  was  interviewed  on  each  job  write-up.  With  only  two 
exceptions,  the  experts  were  sergeants  with  current  flight-line 
experience.  The  expert  was  asked  to  comment  on  the  completeness  of 
the  yrite-up  and,  based  on  it,  to  judge  the  appropriateness  of  the 
actions  taken.  These  comments  are  included  in  the  final  summary 
write-up  under  "Expert  Comments." 

Representativeness  o£  the  Job  Content  Survey 

We  were  concerned  that  the  survey  be  representative  of  the  normal 
work  of  the  avionics  flight-line  shops.  The  interview-debrief 
techniques,  followed  by  expert  review,  were  designed  to  assure 
completeness  and  accuracy  in  recording  the  job  content  of  those  jobs 
surveyed.  There  was,  however,  no  built-in  guarantee  that  the  sample 
would  be  representative.  Although  the  interviewers  made  it  a point  to 
work  all  shifts,  there  was  no  attempt  to  prescreen  interviews  to 
ensure  a representative  sample.  In  fact,  however,  the  sample  was 
representative  of  normal  work  patterns.  To  verify  this,  we  checked 
the  survey  observations  against  Base  Level  Inquiry  System  (BLIS)  data 
for  the  months  of  March  and  April  1975.  A statistical  test  verified 
that  the  sample  did  not  significantly  differ  from  the  work  unit 
distribution  of  jobs  performed  in  those  two  months.  To  test  if  the 
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sjmple  was  reprrsftit  al  i vc  of  th<-  lyp<'s  o(  actions  normally  per  I ormod , 
the  Action  T.ikc-n  Coclc-s  wc-ro  statistically  comparc-d  with  thc‘  Bl.lS 

rc-cords  for  the  same-  period--the  I i rst  two  weeks  cif  April.  Again,  thc‘ 
sample  appc*ars  not  tcj  hc'  nnrc’presc'ntal  i vc'  of  the-  normal  work  pattern. 

SL’KVEY  RESULTS  AND  DIAGNOSTIC  TEf^NlQUES 

The  purpose'  of  the  joh  content  survey  was  to  make  an  accurate 
record  of  the  major  steps  followed  in  the  nia  i ntc'nance  of  avionics 
equipment  on  the  fligfit  line  and  to  identify  the  technicjaes  usc'd  in 
the  joh.  The  188  flight -line  jobs  observed  at  Cannon  AFB  resulted  in 
major  maintenance  actions  in  the  following  nine  work  categories:  AGE 
setup,  troubleshooting,  operational  checkout,  remove/ insta 1 1 , minor 
repair,  checking,  adjustment/a  1 i gnment , test/ inspect , and  safety 
wiring.  Table  9 shows  the  distribution  of  major  maintenance  actions 
by  shop.  Since  more  than  one  action  may  have  been  taken  on  a single 
job,  the  total  number  of  actions  is  larger  than  the  total  number  of 
jobs . 

The  most  important  maintenance  actions  observed  in  the  job  survey 
were  troubleshooting  and  operational  checkout.  Troubleshooting  is  any 
action  undertaken  to  isolate  the  cause  of  a discrepancy.  It  generally 
leads  to  the  replacement  of  an  LRU,  i.e.,  a remove/install  action.  In 
a small  number  of  cases,  the  LRU  is  adjusted  or  calibrated  without 
removal  from  the  .iircrait.  Operational  checkout  is  a prescribed 
procedure  to  verify  that  a system  is  performing  properly.  It 
generally  follows  troubleshooting  and  the  installation  of  an  LRU  or  a 
repair,  align,  adjust,  or  calibrate  action. 


CANNON  JOB  CONTKNT  SUMMARY:  NUMBKK  OK  JOBS 
WITH  KACH  TYFK  OF  ACTION 


Type  of  Action 

Bomb/ 

Nav 

1 list  rumeiit  / 
Aiitopi  lot 

Comm/ 

ECM 

AGE  setup 

38 

IS 

IS 

Troub 1 eshoot i ng 

S5 

18 

22 

Operational  checkout 

27 

16 

10 

a 

Remove/ install 

67 

2U 

28 

Minor  repair 

1 

2 

1 

b 

Check 

12 

8 

8 

Adj  ust/a 1 i gn 

5 

2 

3 

Test/inspect 

0 

1 

0 

Safety  wiring 

0 

6 

0 

c 

Total  jobs 

96 

42 

SO 

a 

Each  removal  or  installation  (R/I)  is  counted  as  one 
action;  thus  a "remove  and  replace”  is  two  R/1  actions, 
b 

Less  than  full  operational  checkout, 
c 

Since  several  actions  may  have  been  taken  on  a 
single  job,  this  is  not  necessarily  the  sum  of  the 
column  above. 
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The  least  prevalent  actions  were  repair,  check,  align,  and 
inspect;  they  occurred  in  only  26  percent  of  the  jobs.  In  most  cases, 
they  were  routine  and  undemanding.  Safety  wiring  is  an 
Instrument/Autopilot  job  that  entails  inserting  steel  wires  in  screws 
and/or  cannon  plugs  to  ensure  that  they  remain  secured.  The  operation 
is  basically  mechanical  and  requires  some  manual  dexterity. 

The  troubleshooting  work  category  is  by  far  the  most  important,  in 
terms  of  maintaining  the  aircraft  in  good  working  order  and  in  its 
requirement  for  job  knowledge  and  training.  As  a part  of  the  job 
content  analysis,  we  were  particularly  interested  in  the  techniques 
used  to  perform  these  tasks.  Table  10  gives  the  major  diagnostic 
techniques  used  in  the  O.S  troubleshooting  jobs.  Although  usage 
differs  by  shop,  the  major  patterns  are  clear.  On  the  average,  two 
techniques  were  used  in  the  Bomb/Nav  shop,  whereas  the  other  two  shops 
required  only  one. 

The  major  diagnostic  techniques  are  described  below. 

Computer  addressing  is  the  technique  most  used  in  Bomb/Nav  jobs. 
Input  and  output  are  through  the  Navigation  Data  Entry  Panel.  This 
procedure  uses  the  computer  memory's  ability  to  retain  information  on 
LKU  malfunctions.  The  technical  order  contains  numerical  input  codes 
("error  trap  addressing")  for  the  various  systems  and  output  codes 
with  a list  of  likely  LRU  failures.  This  technique,  however,  was 
originally  not  part  of  official  troubleshooting  procedure:  the 
computer  memory  address  codes  were  used  to  develop  the  computer 
programs  (software)  by  the  contractor's  systems  programmers  and  were 
first  published  only  in  the  operational  checkout  manual  for  aircrews. 
Through  local  usage  at  Cannon  AEB  they  have  become  accepted 


CANNON  JOB  CONTENT  SURVEY:  NUMBER  OF  TROUBLESHOOTING 
JOBS  USING  VARIOUS  DIAGNOSTIC  TECHNIQUES 


Diagnostic 

Technique 

Bomb/ 

Nav 

Instrument/ 
Autop i 1 ot 

Comm/ 

ECM 

Computer  address 

33 

0 

0 

Built-in  test 

equipment  (BITE) 

18 

7 

9 

Video  display 

22 

8 

1 

Audio  display 

3 

0 

7 

Maintenance  control 
unit  (MCU) 

1 

0 

0 

a 

Diagnostic  R/I 

25 

1 

7 

(84) 

(2) 

(22) 

Special  test 

1 

2 

4 

Total  jobs 

55 

18 

22 

a 

Numbers  in  parentheses  are  total  number  of  R/I 


actions . 

flight-line  troubleshooting  procedure  and  were  recently  incorporated 
in  provisional  maintenance  technical  order  revisions. 

The  computer,  however,  does  not  provide  an  unambiguous 
fault-isolation  capability.  Judgment  is  needed  to  choose  the 
appropriate  code  and  interpret  the  computer  readout.  Comprehensive 
knowledge  of  integrated  avionics  and  system  data  flow  are  required  to 
exploit  this  technique  properly. 


t rouhl  »>shool  i iig  techniques.  F.ither  uiilotnal  i ca  I 1 y or  in  response  to  .1 
test  hy  the  aircrew  or  maintenance  personnel,  the  KICF  system  causes  .1 
fault  leg<‘n(f  light  to  appear  on  the  ATP  or  a m<’ter  to  deficit  anil 
reveal  the  operational  status  of  an  LRU.  Although  the  tests  are 
simple  to  operate,  like  computer  addressing  they  can  lead  to  amhigiioiis 
or  incorrect  conclusions  regarding  LRU  status.  Usually  the  HITK/ATP 
indication  is  verified  by  replacing  one  of  the  indicated  LRUs. 

Observation  of  video  and  otlier  displays  is  a very  common 
diagnostic  technique  in  the  Bomb/Nav  and  Instrument/Autopilot  shops. 
These  procedures  usually  reijuire  a high  degree  of  judgment  and 
advanced  knowledge  of  how  the  integrated  avionics  components  are  tied 
together.  Improper  output  ilisplay  could  be  caused  by  the  display  unit 
itself,  the  computer,  the  sensor  device,  or  the  wiring.  This 
technique  is  analogous  to  troubleshooting  a home  television  set  when 
the  main  indication  is  the  quality  of  the  picture. 

Observation  of  audio  sig^nals  is  the  primary  diagnostic 
technique  used  on  the  communication  equipment.  The  technician 
operates  the  various  systems  in  their  normal  manner  and  listens  to  the 
quality  of  the  audio. 

The  removal  and  installation  of  an  LRU  is  not  only  the 
culmination  of  troubleshooting  but  in  many  cases  is  a diagnostic 
technique  itself.  A iliagnostic  R/ I sometimes  consists  of  using  an 
available  spare  from  supply  or  the  shop  to  confirm  a malfunction. 

When  spares  are  not  available,  LRUs  are  swapped  between  aircraft,  the 
presumably  good  LRU  being  returned  to  the  original  aircraft  after 
(onfirmalion  of  thi-  malfunction.  In  some  cases,  when  spares  are  not 
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.ivailablc  aiut  swaps  are  made,  LRDs  are  removed  ami  sent  to  the  shop  on 
liie  liasis  of  a i)est  guess,  without  strong  supporting  information. 

Many  of  the  K/ I aetions  in  the  job  content  survey  (45  percent) 
were  for  diagnostic  purposes,  as  shown  in  Table  11.  Thirty-five 
percent  of  Ll»e  troubleshooting  jobs  used  tlie  <liagnostic  R/ 1 as  an 
important  troubleshooting  technique.  On  these  jobs  an  average  of  3.4 
R/I  diagnostic  actions  were  recorded.  The  R/I  average  is  1.8  on 
troubleshooting  jobs  where  no  diagnostic  R/Is  were  performed. 


Table  11 

REMOVE  AND  INSTALL  ACTIONS  BY  TYPE  OF  JOB 


Type  of  Job 

Number 
of  Jobs 

Tota  1 
R/Is 

Diagnostic 

R/Is 

T roubleshoot i ng 
with  R/Is 

61 

164 

a 

108 

Operat i ona 1 
checkout 

28 

40 

-- 

Other  jobs 
with  R/ls 

31 

38 

-- 

Jobs  without 

R/Is 

68 

-- 

-- 

a 


Diagnostic  R/Is  occurred  on  only  33  of  the 
troubleshooting  jobs.  The  total  R/Is  for  all 
purposes  on  these  33  jobs  was  112. 


The  K-llin  was  desiRtie<l  so  that  a minimum  ol  special  lest 
e(^uipinent  would  be  needed  on  the  flight  line  to  maintain  the  avic.ni<s 
system.  Special  test  equipment  was  more  frequently  employed  as  a 
diagnostic  aid  in  the  Instrument/Autopilot  and  Comm/ECM  shops  than  in 
the  Bomb/Nav  shop.  In  general,  this  eijuipment  merely  required  the 
reading  of  dials  or  go/no-go  indicators.  The  analog  in  civilian  uses 
is  the  commercial  vacuum  tube  tester.  Although  the  tube  tester  is  a 
precision  measuring  device,  it  is  easy  to  set  and  provides  an  easily 
understood  good/bad  readout.  Such  devices  permit  novices  to  check 
vacuum  tubes  ade(iuately. 

The  Maintenance  Control  Unit,  unique  to  the  Mark  II,  is 
designed  to  print  fault  codes  indicating  specific  LRU  failures. 
According  to  the  Attack  Radar  and  Terrain  Following  Radar  System 
Technical  Manual,  "Troubleshooting  ...  consists  of  observing  FAILURE 
STATUS  lamps  on  the  AVIONICS  TEST  PANEL  and  reading  the  printout  of 
the  MCU  ...  to  determine  malfunctions....  [However],  further 
troubleshooting  may  be  performed  if  built-in  tests  do  not  isolate  to 
the  malfunction."* 

The  survey  shows  that  the  MCU  is  not  being  widely  used  as  a 
diagnostic  aid.  It  was  mentioned  in  only  two  job  interviews,  once  as 
a diagnostic  aid  and  once  as  an  LRU  to  be  repaired.  In  the  latter 
case,  it  was  repaired  last,  instead  of  first,  when  it  might  have  been 
used  in  troubleshooting  other  systems.  The  MCU  printout  is  not  used 
because  the  airmen  have  found  that  it  may  reflect  transient 
malfunctions  and  cannot  be  relied  upon  to  pinpoint  LKU  failures. 


*T0  IF-niD-2-5-2-1,  p.  2-4. 
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Tins  discussion  has  concentrated  on  major  diagnostic  techniques 
use<l  to  t rouh  1 esiioot  the  Mark  II  system.  Kqually  important  is  the 
identification  of  diagnostic  techniques  not  used.  The  job  content 
survey  revealed  that  diagnostic  techniques  associated  with  basic 
electronics  were  rarely  used.  This  was  hardly  a surprise  given  the 
design  ot  the  LRUs,  which,  for  most  purposes,  can  be  viewed  as  sealed 
containers.  Field  maintenance  personnel  do  not  have  access  to  the 
internal  circuitry  of  the  I.KIJ.  In  fact,  in  only  one  case  was  a 
knowleclge  of  basic  electronic  principles  used  and  that  was  by  a 
Technical  Representative  from  General  Dynamics. 

KKFKCTS  OF  SYSTEM  INTEGRATION  ON  FLIGHT-LINE  MAINTENANCE 

The  integration  of  advanced  avionics  affects  flight-line 
maintenance  in  several  ways.  First,  malfunctions  often  occur  in 
several  systems  at  once.  Table  12  shows  the  various  system 
malfunctions  per  sortie  flown  by  one  aircraft  as  part  of  a General 
Dynamics  test  program.  Similarly,  Fig.  2 shows  the  Field  Observation 
Summary  for  Rand  ID  Job  105.  In  this  job,  problems  were  encountered 
on  the  following  systems: 

o Data  Panels  and  Controls 
o Inertial  Navigational  Set 
o Terrain  Following  Radar  Set 
o Altimeter  Set 
o Attack  Radar  Set 

First,  because  of  the  integrated  design  of  advanced 
avionics  systems,  malfunctions  in  one  system  often  affect  the 


GKNKRAI.  DYNAMICS  TKST  AIKCKAKT  68-150: 
NUMBKK  OK  MAI.FIJNCTION  WRITKUPS 


a 

Mai  fijiu  l iotiiiiK  System 


F 1 i ght 
Number 

ARS 

DRS 

IDS 

DCC 

INS 

HSD  SMS  MCU 

OFF 

'1  o t a 1 
Report 

1 

2 

I 

1 

1 

1 

:i 

0 

A 

1 

1 

5 

1 

1 

2 

6 

1 

1 

7 

1 

1 

8 

3 

3 

0 

1 

1 

U) 

1 

1 

11 

1 

1 

1 

1 

A 

12 

2 

1 

3 

n 

1 

1 

1 

1 

A 

lA 

1 

2 

1 

A 

15 

1 

1 

1 

1 

A 

16 

1 

1 

1 

3 

17 

1 

1 

18 

1 

1 

2 

19 

1 

1 

1 

1 

A 

20 

1 

1 

1 

3 

21 

1 

1 

22 

1 

1 

2 

2.3 

1 

1 

2 

2A 

0 

25 

1 

1 

2 

26 

1 

1 

2 

27 

1 

1 

a 

ARS 

DRS 

IDS 

DCC 

INS 

HSD 

SMS 

MCU 

OFF 


Attack  Radar  System 
Doppler  Radar  System 
InteRrated  Display  Set 
Digital  Computer  Complex 
Inertial  Navigation  Set 
Horizontal  Situation  Display 
Stores  Management  Set 
Maintenance  Control  Unit 

Operational  Flight  Programs,  i.e.,  the  computer 
sof  tware . 
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port ormatice  of  others.  For  example,  Table  12  shows  an  Allaik  Radar 
System  malfunction  on  flight  13.  The  discre{)ancy  was  "ARS  video  weak 
and  lost  sweep  on  ground."  The  General  Dynamics  Fault  Isolation 
Verification  Program  (FIVP)  team  found  that  "weak  vicleo  seemed  to  he 
related  to  STD  (Signal  Transfer  Unit,  a LRU  in  the  Integrated  Display 
Set)."  However,  an  F.PU  (Fllectronic  Processor  Unit,  a LRU  in  the  ARS) 
was  removed  because  "malfunction  seems  to  indicate  that  the  EPU  was 
failing  intermittently."  On  a previous  flight,  the  FIVP  team 
attributed  this  discrepancy  to  a bad  Multi-Sensor  Display,  another  LRU 
in  the  Integrated  Display  Set.  Similarly,  on  the  job  shown  in  Fig.  2 
the  maintenance  technician  attributed  an  Inertial  Navigation  Set 
problem  to  a faulty  Navigation  Data  Entry  Panel.  Subsequent  check  of 
349  data  shows  that  no  defects  were  detected  on  the  Data  Entry  Panel 
in  the  shop  and  the  Inertial  Navigation  Set  failed  on  the  next  flight. 

Second,  avionics  system  malfunctions  do  not  always  honor  the 
divisions  between  the  three  flight-line  maintenance  specialties.  We 
found,  for  example,  that  both  the  TACAN  (Tactical  Air  Navigation)  and 
1 LS  (Instrument  Landing  System)  in  Comm/ECM  may  be  affected  by 
failures  in  Bomb/Nav  systems.  An  example  is  provided  by  Raiul  ID  No. 
60,  shown  in  Fig.  3. 

Third,  unlike  the  maintenance  of  previous  avionics  systems, 
maintenance  of  F-llI  avionics  equipment  requires  technicians  to  use 
the  f aul t- iso lat i on  capability  built  into  the  system.  Tiis  would  make 
the  job  easy  and  routine  if  the  BITE  provided  unambiguous  indication 
of  LRU  failure.  Such  is  not  the  case.  Because  of  generally  poor 
f au 1 1- i so  I at  ion  capability  on  the  F-lllD  Mark  II,  the  F-111  Special 
Projects  Office  contracted  with  General  Dynamics  to  study  fault 
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isolation  on  the  K-llll).  The  1974  Gonoral  Dyiiami  i s KlVl'  loam 
c'oiirlinicd  that  the  f au  1 1 - i so  1 at  i on  capaGility  was  i na(l(M|iiate 
hrcausf : * 

1.  Avionics  Tost  Panol  logonds  and  Mainlonanco  Control  Unit 
printouts  indicate  failuros  wtu'ii  no  faults  are  prosont  in 
the  system. 

2.  Faults  occur  that  are  not  indicatod  6y  the  ATF  and/or  MCI/ 
printouts . 

3.  In  a failure,  the  incorrect  LRU  may  be  indicated  as  faulty. 

4.  The  flighl-line  techiiical  orders  and  special  trout>leshoot  ing 
are  incomplete  or  erroneous  in  many  cases. 

To  overcome  these  shortcomings,  and  because  of  the  idiosyncratic 
nature  of  each  advanced  integrated  avionics  system,  maintenance 
tecJinicians  need  a thorough  knowledge  of  the  particular  avionics 
system  they  are  going  to  work  on.  For  example,  on  the  F-lllD  the 
Attack  Radar  System  feeds  data  to  the  Digital  Computer  Complex  and  the 
Integrated  Display  Set.  General  Dynamics  noted  that  depending  on  the 
type  of  signal,  mode  of  operation,  operator  action,  and  timing  of 
output,  the  fault  status  indication  of  a particular  LRU  may  or  may  not 
be  valid.  A failure  in  a particular  mode  can  be  caused  by  a problem 
in  any  one  of  five  LRUs,  which  are  classified  in  two  major  systems. 
Isolating  a malfunction  in  this  mode  requires  a "thorough 
understanding  of  the  mode  of  operation."**  In  another  case,  they  found 
the  fault-isolation  capability  to  be  ambiguous,  with  most  faults  being 

*F - 1 1 ID  Mark  1 1 _F a_u Ijt ^ s ql a t i on  Verification  Program  (F IVP)  , 

Final  Report,  Vol.  I,  Analysis , General  Dynamics  Corporation,  Convair 
Aerospace  Division,  Fort  Worth,  Texas,  FZM-12-8308,  July  1,  1974, 
pp.  1-4. 

*-*FlVP,  Vol.  I,  p.  2-1  l.S. 
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ihe  "result  of  a ma  1 f uiirt  i on  of  arioltier  system,  another  LRU  within  the 
system  or  an  operator  procedure  error." 

Effective  use  of  the  BITE  requires  that  maintenance  personnel  be 
educated  in  the  use  and  interpretation  of  the  MCU  printout,  which  must 
be  read  in  combination  with  the  original  "squawk,"  indications  from 
the  BITE,  and  computer  readouts.  In  many  instances,  the  se<)uence  of 
MCU  printouts  must  be  related  to  the  sequence  of  tests  run  through  the 
computer  to  isolate  the  faulty  LRU.  It  can  no  longer  be  assumed  that 
troubleshooting  consists  of  observing  a BITE/MCU  code  and  removing  an 
LRU. 

The  key  to  effective  and  efficient  maintenance  work  is  the 
ability  to  use  all  diagnostic  tools  to  increase  the  accuracy  of 
diagnosis  and  to  decrease  the  time  expended  on  maintenance  actions. 
Choosing  the  appropriate  sequence  of  actions  is  the  demanding  aspect 
of  maintenance.  Although  designed  to  indicate  the  systems  at  fault 
quickly  and  clearly,  the  Mark  II  avionics  system's  diagnostic  aids  do 
not  provide  unequivocal  information.  Thus,  the  maintenance  technician 
must  play  detective,  developing  clues  and  interpreting  them  as  he 
works  through  the  interrelationships  of  the  system  and  using  a mix  of 
diagnostic  techniques  in  his  search  for  the  one  or  more  defective 
LRUs. 

THE  NATURE  OF  FLIGHT-LINE  MAINTENANCE 

Jobs  in  the  Bomb/Nav  specialty  can  be  very  complex  because  the 
avionics  systems  are  highly  integrated  and  fairly  unreliable,  and 
because  maintenance  personnel  must  rely  on  indirect  indications  of 
faults  (provided  by  the  system)  that  are  ambiguous.  A large  number  of 
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Bomb/N.jv  jobs  (dvoi  h.i  1 f in  oiir  sain|il(‘)  r<‘<inir(*  I roiih  1 J'sliool  i nj; . In 
many,  ni.i  i nl  enaiu'c  jitTsomu’l  must  know  liow  Lo  nso  a coml)  i nal  i on  ol 
liia^nostii  lethiiKjiK's  lo  ri'solve  aml>  i gn  i I i cs  . I’rol  i c i ont  fault 
isol.ilion  of  Boml)/Nav  sysU'nis  often  also  re<)uires  knowledge  ol  the 
ul  1 osync ras 1 es  of  the  avionits  patka^e,  that  is,  of  how  tfie  components 
and  lln'  I.HUs  within  them  interact  in  various  opc‘rating  modes. 

fhe  I list  rumenl/Autop  i 1 ot  and  Comm/KCM  s|)ecialties  are  less 
difficult.  Trouhleshoot i ng  is  required  somewhat  less  often,  and  fault 
isol.it  ion  usually  reipiires  only  one  Lechnicjue.  There  is  more  stress 
on  I nt erpri'l at i on  ol  video  displays  in  Instrument/  Autopilot  and  more 
on  audio  in  Comm/F.CM.  Nc-ither  specialty  uses  the  computer  as  a 
diagiioslit  aid.  Both,  especially  Comm/KOM,  occasionally  use  special 
l(>sl  sets.  Systems  in  these  specialties  are  less  highly  integrated 
than  .ire  the  Bomh/Nav  systems,  although  there  are  some  interactions 
.imoiig  systems  and  between  Comm/ECM  systems  and  Bomh/Nav  systems.  Some 
operational  knowledge  ol  particular  avionics  systems  would  appear  to 
he  useful  for  Conim/ECM  (and  should  not  he  ruled  out  for 
1 list  riimcuit/Autopi  lot ) , hut  less  depth  of  understanding  is  required 


than  for  Bomh/Nav. 
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IV.  KKVIKW  AND  KVAl.UATION  OK  TRAINING 
IN  TIIK  T26X2  CARKKK  KIKI.DS 


I ti  llif  previous  seclioii,  we  examineil  the  joh  ol  maiiilaiiiing  on 
the  I light  liiH'  the  new  generation  of  a(lvanc<-<i  avionics.  In  this 
si’clion,  we  examine  in  <letai  I the  way  airmen  are  trained  in  th<‘  .126X2 
AKS.  We  concentrate  on  trainuig  for  the  Bomh/Nav  shop  (.326X2A), 
discussing  training  in  that  specialty  as  it  was  until  the  autumn  of 
1973,  and  recent  modifications,  current  training  in  the  other 
(light-line  specialties,  and  TAC's  Task  Oriented  Training  program. 


BASIC  TECHNICAL  TRAINING  IN  THE  BOMB/NAV  SPECIALTY 
BEFORE  AUTUMN  1973 

Even  before  Rand  began  its  study  of  avionics  training,  there  were 
strong  indications  that  something  was  wrong  with  326XX  training.  In 
the  spring  of  1974,  the  Avionics  Superintendent  Steering  Grouji  (ASSG) 
concluded  that: 


In  the  past  six  years,  several  new  (F-111  model)  aircraft 
have  proliferated  into  inventory.  This  has  overextended  the 
scope  of  the  326XX  ASC . The  training  of  personnel  for  the 
early  AKSC  structure  was  ...  considered  adequate  at  its 
inception.  However,  as  the  scope  of  the  AFSC  structures  was 
extencled,  the  training  concept  did  not  meet  the  i eeds  of  the 
users .... 

Representative  training  involves  training  on  a selected 
item  of  eipiipment  which  is  similar  to  or  representative  of 
one  or  more  other  pieces  of  equipment.  However,  for  the 
326XX  AKSC,  the  equipment  used  for  training  is  only 
partially  representative  of  the  equipment  that  the  trainee 
will  encounter  in  the  field.  Previous  meetings  and  studies 
have  concluded  that  the  present  representative  training 
concept  is  not  meeting  the  demands  of  the  users.... 

This  committee  recommends  that  representative  training 
he  replaced  with  weapons  systems  oriented  training. 
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Howpvi'r,  whal  the  ASSG  did  not  note  was  that  specific  weapons  systems 
training  is  necessary,  but  not  sufficient,  to  ensure  adec^uaLe  job 
training. 

In  examining  326  training,  we  found  that,  independent  of  the 
representative  training  issue,  the  basic  three-level  Bomb/Nav  course 
at  Lowry  AFB  did  not  stress  the  skills  that  airmen  needed  and  used  on 
the  job.  Table  13  shows  the  Plan  of  Instruction  (POl)  for  the  basic 
course  through  which  most  of  the  current  (first-term)  maintenance 
force  has  passed.  It  shows  a heavy  emphasis  on  basic  theory  (30 
percent)  and  systems  familiarization  (49  percent).  Instruction  of 
actual  job  performance  was  limited  to  64  hours  or  11  percent  of  the 
course,  with  only  half  of  that  "hands  on"  experience  on  trainers. 
Moreover,  the  trainers  themselves  were  not  sufficiently  linked 
together  to  provide  a reasonable  facsimile  of  an  integrated  avionics 
system . 

The  course  first  exposed  the  student  to  six  weeks  of  basic 
electronics  theory,  covering  such  topics  as  Series-Parallel  Circuit 
Analysis  (6  hours),  Vacuum  Tubes  and  Tube  Testing  (6  hours),  and 
Semiconductor  Theory  and  and  Solid-State  Diodes  (7  hours).  Based  on 
our  job  content  analysis,  we  cannot  relate  these  topics  to  actual  job 
procedures.  Moreover,  these  topics  are  not  even  related  to  subsequent 
instruction  in  the  Bomb/Nav  POI . 

After  completing  basic  electronics,  the  students  received 
instruction  in  each  individual  avionics  system.  The  skills  taught 
were  abstract  and  only  indirectly  related  to  job  performance.  For 
example,  instruction  in  the  Attack  Radar  System  began  with  15  hours  of 
fami 1 i ar izat ion  with  operational  and  performance  characteristics. 


ANALYSIS  OF  PLAN  OF  INSTRUCTION  FOR  COURSE  3ABR32632A 
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(Hands-on)  (31)  (5.4) 


Next  tamt'  hours  (1-1/2  w«'«>ks)  in  which  studetits  "trace  the  dat.i 
flow  ...  [of  variousl  circuits  on  functional  block  diagrams."  The 
criterion  objective*  o(  this  instruction  was  "given  TO  ...  and 
simplified  functional  diagrams  on  |various|  circuits,  lah<*l  missing 
pins,  plug  iiumhers  and  signal  names,"  m.istery  ol  which  is  only 
tenuously  relateil  to  job  performance.  hast,  four  hours  were  lievoted 
to  troubleshooting  procedure.s.  The  instruction  from  the  F(Jl  slressi'il 
theoretical  rather  than  practical  troubleshooting,  i.e.: 

Discuss  the  procedures  used  for  ARS  troubleshooting. 

Using  illustrations  from  the  TO  and  troubleshooting  logic 
diagrams,  demonstrate  how  to  isolate  malfunctions  to  a 
line  replaceable  unit.  Have  the  students  complete  all 
workbook  projects.** 

The  criterion  objective  for  troubleshooting  jirocedures  also 
stressed  a rather  artificial  view  of  the  techni<)ue:  "(liven  the  TO  and 
a list  of  five  ARS  malfunctions,  write  the  probable  cause  for  each  ARS 
ma 1 f unct i on . " 

After  the  student  completed  221  hours  of  instruction  on  the 
individual  avionics  systems,  he  was  given  'lA  hours  on  the  integrated 
avionics  systems.  Most  of  this  time  (45  hours)  the  student  traced 
functional  diagrams.  The  performance  part  was  5 hours  at  the  end  of 
the  course  for  the  student  to  learn  procedures  for  the  operational 
checkout  of  four  major  systems--the  Attack  Radar  System,  Optical 
Display  Sight  System,  Digital  Computer  Complex,  and  Control  and 
Display  Set.  Moreover,  he  was  not  required  to  master  these  skills. 

*A  criterion  objective  states  the  conditions  under  which,  and  the 
criteria  by  which,  mastery  is  to  be  judged. 

)ABR12612A. 


Tin*  criterion  objective  recjin  red  that  given  th«'  tethiiical  orders  he 
rmisl  "list  the  p roiedii res  for  the  operational  ctieckoiit." 

As  the  culmination  of  tfie  course,  the  students  were  supposed  to 
receive  t«*n  hours  of  integrated  troubleshooting  on  bench  trainers,  hut 
fiecause  of  the  size  of  the  class,  each  student  spent  substantially 
less  tim»’  on  the  trainer. 

The  above  course  of  instruction  seems  to  be  only  partially 
consistent  with  the  126X2A  Specialty  Training  Standard  and  the 
reipiirements  for  awarding  of  the  3-skill  level.  The  course  may  well 
provide  sufficient  "subject  knowledge"  to  allow  a student  to  "explain 
relationships  and  stale  general  principles"  about  "attack  radar 
systems  major  components,  modes  of  operation  and  displays"  as  well  as 
do  a "functional  block  diagram  analysis  of  attack  radar  systems." 
However,  graduates  of  the  course,  according  to  the  STS,  should  also  be 
sufficiently  proficient  so  that  they  can  perform  operational  checks, 
remove  and  replace  systems  components,  perform  adjustment  and 
alignment,  perform  sel f-test/BlTE , and  troubleshoot.  They  should  be 
able  to  "do  most  parts  of  the  task,"  needing  "help  only  on  hardest 
part."  The  course,  however,  does  not  require  that  a student 
accomplish  any  of  these  tasks  before  graduation. 

The  inadequacy  of  the  3-level  course  as  training  for  job 
performance  was  verified  in  several  ways.  In  the  debrief  interviews 
in  the  job  content  survey,  we  asked  each  technician  about  the  source 
of  training  for  the  steps  he  was  carrying  out.  The  options  included 
on  the  job  training,  Field  Training  Detachment,  Task  Oriented  Training 
(irogram  (TOT),  and  technical  school.  Table  14  shows  their  responses. 
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Table  14 

SOUKCF.  OF  PFKTINFNT  TRAINING 
(Number  of  Responses) 


Training 


.Shop 

Technic ians 
Intervi ewed 

OJT 

FTI) 

TOT 

Tech  School 

Bomb/Nav 

67 

67 

14 

5 

5 

1 nst  rument / 
Autopi lot 

37 

3? 

1 

-- 

7 

Cotnm/FCM 

34 

34 

21 

-- 

3 

Tota  1 

138 

138 

36 

5 

15 

On  the  job  training  includes  all  experience  acquired  while  a 
person  is  assigned  to  the  flight  line,  whether  or  not  he  is  under  the 
guidance  and  direction  of  an  official  OJT  trainer.  The  three-month- 
old  TOT  program  was  available  only  in  the  Bomb/Nav  shop,  where  the 
technical  school  training  course  was  given  as  the  source  of  knowledge 
in  only  5.5  percent  of  the  responses. 

The  TAG  questionnaire  administered  in  early  1974  to  a large 
number  of  326  AFS  personnel  provides  an  additional  means  to  evaluate 
the  technical  school  training  course,  as  well  as  the  other  32632 
courses.  Since  the  questionnaire  was  unstructured,  responses  were  not 
uniform  and  statistical  comparisons  cannot  be  made.  However,  the 
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gonrral  lone  was  ijiiite  clear;  the  respondents  were  critical  of  32632 
training  in  the  following  ways: 


o Basic  electronics  were  irrelevant;  training  in  fundamentals 
and  systems  were  unrelated. 

o There  was  too  much  theory  and  not  enough  practical  training; 
training  equipment  was  not  used  or  did  not  work;  and  training 
was  too  abstract. 

o Training  was  irrelevant  to  the  job,  and  instructors  lacked 
job  experience. 

o There  was  too  little  training  on  systems  integration  and  on 
troubleshooting  integrated  systems;  too  much  training  on 
inner  circuitry. 


In  the  spring  of  1974,  after  trips  to  Nellis  and  Mountain  Home 
AFBs , an  Air  Training  Command  evaluation  team  noted  the  following 
problems  with  the  32632A  course; 


o More  integration  training  involving  the  Digital  Computer 
Complex  is  required. 

o Not  enough  performance  training  is  given  in  technical 
school.  F'roblems  provided  in  technical  training  do  not 
relate  to  actual  problems. 

o Instructors  are  qualified  to  teach  technical  orders  and 
theory,  but  they  are  not  familiar  with  the  aircraft. 

o Graduates  are  not  familiar  with  the  cockpit  layout  or  with 
cockpit  procedures. 

o Although  the  technical  school  teaches  how  to  fill  out  forms, 
the  graduates  are  not  familiar  with  how,  when,  and  why  each 
form  is  used. 

o Training  equipment  is  not  working  most  of  the  time. 

o Graduates  are  not  always  assigned  to  FTDs  at  completion  of 
residence  training.  Consequently,  some  graduates  are  not 
formally  trained  on  maintenance  of  the  inertial,  doppler.  Low 
Altitude  Radar  Altimeter,  and  Terrain  Following  Radar 
systems . 


o (loiifsos  laiiglit  hy  the  I 'IDs  arc  rcfiniiilaiit  with  l.owry  AKB 

courses,  i . , grailiialcs  rcccMvc  llu-ory  Iraiiiiiig  oti  the'  same 

systems  t.iuglit  at  Dowry  Al-'B. 

o Most  graduates  interviewed  coisidc'red  the  Lowry  AIB  course* 

1 uadecju.itc*  lor  doing  their  job.  Graduates  and  supe  rv  i sc^rs 
recommended  that  Lowry  APR  provide  electronics  fundamentals 
and  system  principles  training  and  let  the  PTDs  and  Od'i' 
provide  the  particular  system  tr.iining. 


Unlortunately , the  conclusions  of  the  official  Training 
Kvaluation  Report  (LO  7A-20),  August  197A,  touched  only  mildly  on 
representative  training  ancl  then  noted  that  "This  is  a normal 
condition  when  the  graduates  may  he  assigned  to  more  than  one  model 
aircraft."  Thc*y  did  not  mc'tition  any  of  the*  problems  due  to  a lack  ol 
job  performance  tr.iining.  The  only  recommc'iidat  i on  was  that  "the* 
tr.iining  clep.i rlmc'iil  take  positive  action  to  secure  aciditional 
t r.i  inc*rs  . " 


TRAINING  OP  ADVANCKI)  PPRSONNKL  IN  THK  BOMB/NAV  SPKCIAL'rV 
BKPORK  1<17^ 

Because  avionics  maintenance  is  idiosyncratic  to  different  models 
of  .iircraft  and  because  the  job  changes  after  the  aircraft  have  heen 
introduced  in  operating  units,  personnel  newly  assigned  to  maintain 
advanced  avionics  on  particular  aircraft  need  to  be  familiarized  with 
the  job,  regardless  ol  the  extent  of  their  prior  experience.  Such 
familiarization  was  supposed  to  be  provided  by  the  7-level  course 
given  at  the  PTDs.  Thc're  were  three'  difficulties  with  the  application 
of  this  policy:  many  new  arrivals  received  no  familiarization 
training,  the  7-level  course  varied  widely  in  thoroughness  among  the 
PTDs,  and  the  cjiiality  of  the  7-level  courses  was  degraded  because  they 
were  use'd  to  familiarize  both  neophytes  and  old  hands  simultaneously. 


t roni  <)l  he  r 


Although  porsoiiiiol  transferred  into  the  i2h  AKS 
specialties  were  supposed  to  he  c ross-t  ra  i ned  to  the  new  spc'cialty, 
usually  at  the  FTD  at  the  base  of  first  <iss  i gnment  this  iiolicy 
freijucntly  was  not  followed,  primarily  because  of  the  need  for  senior 
personnel  in  the  shop.  Table  15  shows  that  nearly  half  of  the  7-  and 
9-level  personnel  in  the*  Bomh/Nav  specialty  at  Cannon  and  Mountain 
Home  AFBs  had  no  formal  training  in  the  326X2A  specialty,  ac'cording  to 
their  own  reports.  This  problem  is  not  peculiar  to  the  326  AFS , 
however.  The  Avionics  Superintendent  Steering  Group  noted  in  May  1974; 


In  the  past  there  was  advanced  7-level  formal  training 
during  the  time  when  peculiar  system  training  was  provided 
at  the  entry  level.  That  training  was  not  supported  by 
MAJCOM  because  they  did  not  want  to  lose  technicians  for  a 
period  of  time,  so  formal  7-level  training  was 
eliminated....  Now  there  is  basically  no  formal,  advanced 
training  for  avionics  technicians.  Advantages  of 
implementing  this  type  training  would  include;  (1)  A better 
technically  qualified  maintenance  force,  (2)  Improved  job 
motivation  and  satisfaction,  (3)  Improved  systems 
reliability  capability  and  MTBF,  (4)  Provide  improved 
comprehension  of  complex  system  integration  problems 
encountered  by  middle  management. 


The  ASSG  recommended  that  comprehensive  7-level  courses  be 
established  at  resident  schools  and  that  the  training  be  mandatory  for 
all  AFSC  32XXX  technical  sergeants  before  they  advanced  to  master 
sergeant .** 


*Personnel  at  and  above  the  7-level  in  the  Bomb/Nav  work  centers 
generally  were  drawn  from  the  322  and  301  (now  the  328)  AFSs.  For 
example,  in  September  1974  in  the  Bomb/Nav  specialties  at  Cannon  and 
Mountain  Home  AFBs,  60  percent  of  the  men  who  identified  their  prior 
AFS  had  been  322s,  45  percent  had  been  301s  (several  had  held  both 
AFSs),  and  only  one  reported  that  he  had  had  3-level  training  in  the 
326X2A  field.  These  data  are  derived  from  a survey  Rand  administered 
to  all  AMS  personnel  at  Cannon  and  Mountain  Home  AFBs  in  September 
1974. 

on^  Ai^  Force  ^ionics  Superintendent  Steernig  Group  (ASSC^ 
1974  Meeting,  Attachment  C. 
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Table  15 

SELF-REPORTED  EXPERIENCE  AND  TRAINING  OF  7-  AND  9-LEVELS 
IN  THE  BOMB/NAV  SPECIALTY 


Percent  of 

Respondents 

Base 

a 

(1) 

With  Work 
on  Less 
than  Half 
of  Systems 
in  Previous 

6 Months 

b 

(2) 

With 

Limited 

F-111 

Experience 

c 

(3) 

With  OJT 
on  Less 
than  Half 
of  Systems 

(4) 

With  No 
Forma  1 
Training 
in  326  AFS 

Cannon 

56 

33 

42 

58 

Mountain  Home 
d 

50 

38 

55 

36 

Average 

53 

35 

48 

48 

SOURCE:  Data  on  which  this  table  is  based  are  found  in  Tables 

A-1  and  A-3  in  the  appendix, 
a 

Does  not  include  personnel  assigned  within  previous  six 
months . 
b 

Includes  personnel  who  worked  both  less  than  half  of  the 
systems  during  the  previous  six  months  and  less  than  half  of  the 
systems  during  prior  assignments  to  an  F-111  base,  if  any. 
c 

Includes  personnel  assigned  within  past  six  months  if  they 
reported  working  on  more  than  half  of  the  shop  systems  at  a prior 
F-111  base, 
d 

Averages  weighted  for  different  numbers  of  personnel  in  the 
two  work  centers. 


Table  15  also  shows  that  nearly  half  the  respondents  reported 
having  had  OJT  on  less  than  half  of  the  systems  assigned  to  their 
current  work  center  and  over  half  had  worked  on  less  than  half  of 
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these  systems  during  the  preceding  six  months.  This  general  lack  ol 
contact  with  the  job  was  partially  ameliorated  by  prior  experience, 
with  only  about  a third  reporting  limited  familiarity  with  the  F-111 
systems  at  any  F-111  assignment.  Even  so,  a relatively  large  number 
ot  supervisory  personnel  in  the  work  center  lack  formal  training  in 
the  job  or  have  little  day-to-day  contact  with  it. 

The  design  of  basic  technical  training  in  the  Bomb/Nav  specialty 
also  affected  the  advanced  training  given  at  the  FTD.  To  compensate 
for  the  representative  training  given  at  Lowry  AFB,  the  7-level  course 
was  used  at  each  base  to  familiarize  the  new  3-level  with  the  resident 
F-111  model.  The  courses  at  the  various  FTDs  were  dramatically 
different  in  length,  for  reasons  apparently  unrelated  to  the 
complexity  of  the  particular  avionics  systems.  Table  16  compares  the 
various  7-level  courses  at  the  FTDs.  It  may  be  seen  that  instruction 
on  the  ARS  ranged  from  34  hours  at  Cannon  AFB  to  126  hours  at 
Plattsburg  AFB.  Systems  integration  was  taught  formally  only  at 
Nellis  AFB. 

Not  only  were  new  3-levels  sent  to  the  FTDs,  but  other  personnel 
new  to  the  base,  who  already  had  flight-line  experience  with  either 
the  F-111  or  other  aircraft,  were  supposed  to  take  the  same  course,  so 
they  too  could  become  familiar  with  the  particular  F-111  model  they 
would  be  working  on.  The  result  was  that  classes  in  the  7-level 
course  were  frequently  composed  of  a mixture  of  neophytes  and  old 
hands.  For  example,  in  the  five  classes  graduating  from  the  7-level 
course  between  June  and  November  1974  at  Cannon  AFB,  the  ratio  of 
neophytes  to  more  experienced  personnel  was  1.3:1,  on  the  average 


*Data  derived  from  Rand  1974  survey  mentioned  earlier. 
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Tab  If  16 

7-LKVKb  FTU  COIJKSKS  4AHH32672A 

a 

(Course  Hours) 


F-lll 

FTD  Base 

Cannon 

Mt . Home 

Nellis 

Plattsburg 

Course 

F-1 1 ID 

F-lllF 

F-lllA 

FB-1 1 lA 

b 

Introduce  ion 

11 

0 

15 

30 

DCC 

22 

38 

(c) 

0 

INS 

18 

16 

47 

177 

DRS 

10 

(c) 

(c) 

22 

USD 

12 

(c) 

(c) 

22 

IDS 

22 

(c) 

(c) 

(c) 

TFR 

22 

33 

42 

79 

ARS 

34 

58 

66 

126 

d 

DBT 

2 

3 

(c) 

(c) 

ODSS 

(c) 

15 

(c) 

17 

LARA 

4 

12 

e 

LCOSS 

(c) 

(c) 

28 

(c) 

Systems 

I ntegraton 

0 

0 

44 

0 

Total 

153 

167 

242 

485 

a 

Less  measurement  and  critique  hours, 
b 

Integrated  with  course  material, 
c 

F-lll  model  does  not  have  this  avionics  system, 
d 

Dual  Bombing  Timer. 

Lead  Computing  Optical  Sight  System. 


e 
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Because  the  KTD  courses  were  taught  as  .i  group,  the  iestriictor  had 
an  almost  insoluble  problem--to  give  the  new  3-level  the  training  he 
needed  without  losing  the  attention  of  the  old  hand  and  to  address  the 
more  sophisticated  concerns  of  experienced  personnel  without  going 
over  the  head  of  the  neophyte.  The  result  was  a course  that  may  often 
have  been  neither  effective  nor  efficient  for  either  group  of  students. 


TRAINING  IN  THE  INSTRUMENT/AUTOPILOT  AND  COMM/ECM  SPECIALTIES 

The  job  content  analysis  supported  the  common  understanding  that 
both  of  these  specialties  are  less  difficult  than  the  Bomb/Nav 
specialty;  therefore,  deficiencies  in  training  for  them  would  be  less 
damaging  to  job  performance.  In  addition,  maintenance  of  equipment 
associated  with  these  specialties  poses  less  of  a problem  for  the  AMS, 
so  that  the  Air  Force  has  been  less  concerned  about  possible 
shortcomings  in  personnel  support  for  this  equipment.  Unfortunately, 
there  is  evidence  that  both  specialties  suffer  from  some  of  the  same 
training  problems  as  does  the  Bomb/Nav  specialty.  Since  the  training 
programs  have  not  been  revised  (as  has  the  training  for  Bomb/Nav), 
these  deficiencies  remain  in  the  present  programs. 

Inst  rument/Autopilot 

According  to  the  chart  for  the  basic  course  3ABR32632B  as  of  May 
IN7J,  174  hours,  or  4S  percent,  of  the  course  was  devoted  to  the  study 
f >-'jm  pi««-nt  . The  remainder  was  study  of  electronic  principles  (39 
• < rn*  I itid  1 iinilamenta  1 s (16  percent)  such  as  maintenance  managemetit 
'♦•'hiiu.il  order  syste'm.  The  equipment  taught  and  the  hours 
• iti  1 1 «-iii  are  shown  in  Table  17.  The  training  equipment 


* > M A pr  og  r am . 
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Table  17 

EQUIPMENT-ORIENTED  PORTION  OF  COURSE  3ABR32632B, 
INSTRUMENT/AUTOPILOT 

System  Hours 

Engine  instruments 36 

Tachometer  systems (3.5) 

Temperature  indicating  system (A) 

Variable  reluctance  pressure 

indicating  system (6) 

Synchro  indicating  systems (10) 

Capacitance  type  liquid  quantity 

indicating  system (10.5) 

Oil  quantity  indicating  system (2) 

Flight  instruments 30 

Pitot  static  system (10) 

Central  air  data  system (18) 

Aircraft  structural  integrity  program 

flight  data  recorders (2) 

Integrated  flight  and  navigational  instruments..  54 

Direct  reading  (standby)  compass (4) 

Auxiliary  flight  reference  system (19) 

Swing  and  compensation  of  the  gyro 

stabilized  magnetic  compass  system (13) 

Flight  director  system (18) 

Integrated  flight  controls 53 

Flight  controls (8) 

Trim  systems (7) 

ASFC  stability  augmentation (18) 

Computer  self-test (3) 

ASFC  auto  pilot (8) 

Automatic  flight  control  systems 

(troubleshooting) (9) 
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Graduates  of  this  course  who  responded  to  the  TAG  questionnaire 
noted  the  same  general  type  of  training  deficiencies  as  did  graduates 
of  the  Lowry  AFB  course  in  the  Bomb/Nav  specialty,  such  as  lack  of 
practical  training  and  irrelevancy  of  most  basic  electronics  training 
to  the  job.  The  lack  of  practical  training  at  technical  school  (at 
Chanute  AFB  in  this  case)  undoubtedly  explains  why  technical  school  was 
mentioned  as  the  source  of  pertinent  training  for  only  16  percent  of 
the  Instrument/Autopilot  maintenance  actions  in  the  Job  content  survey 
(see  Table  14) . 

Finally,  as  in  the  Bomb/Nav  specialty,  personnel  at  the  7-level 
and  above  lack  training  and  direct  experience  in  the  job.  Of  the  13 
Instrument/Autopilot  respondents  to  the  Rand  survey  at  Cannon  and 
Mountain  Home  AFBs  who  identified  their  prior  AFSs , 85  percent  had 
formerly  been  325s  and  23  percent  had  been  422s.*  Table  18  shows  the 
self-reported  experience  and  training  of  these  personnel.  Note  that 
although  respondents  report  themselves  to  be  more  deficient  in  both 
formal  and  on  the  job  training  than  the  Bomb/Nav  personnel,  they 
report  greater  direct  familiarity  with  the  job. 

Co^un  ^ a_^i  ons/ECM 

As  mentioned  previously,  basic  training  for  this  specialty  is 
given  in  a 9-week  course  at  Keesler  AFB,  followed  by  a 10-week, 
equipment-oriented  course  at  one  of  the  FTDs . After  this,  the  new 
3-level  is  assigned  to  one  of  the  F-111  bases,  which  may  or  may  not 
support  the  model  associated  with  the  FTD  that  has  trained  him. 

*Data  from  which  these  figures  were  derived  are  found  in  Tables 
A-1  and  A-4  in  the  appendix. 


SKI.K-RKPOKTKI)  KXl'KK  I KNCK  AND  TKAINlNf."  OF  7-  AND  9-I,KVKLS 
IN  THK  INSTKliMFNT/Ainot’ILOT  SPKCIALTY 


I'ercent  of 

Respondents 

3 

(1) 

With  Work 
on  Less 

b 

(2) 

c 

(3) 

(4) 

than  Half 

Wi  tb 

With  OJf 

With  No 

of  Systems 

l.imi  ted 

on  Less 

Forma  1 

in  Previous 

F-1  1 1 

t ban  Ha  1 i 

Tra i n i ng 

base  (> 

Months 

Kxpe  r i ence 

of  Systems 

in  326  .AFS 

Cannon 

20 

0 

8:i 

57 

d 

Mount.iin  Home 

so 

33 

100 

57 

Average 

33 

18 

8;5 

57 

SOIJRCK:  Data 

on  which 

this  table  is 

liased  arc*  found 

in  Tables 

A-2  and  A-4  in  the  appendix, 
a 

Does  not  include  personnel  assigned  within  previous  six 
months . 
b 

Inc  ludes  personnel  who  worked  both  less  than  half  of  the 
systems  during  the  previous  six  months  and  less  than  half  of  the 
systems  during  prior  assignments  to  an  F- 1 1 1 base,  if  any. 

f 

Includes  personnc-l  assigned  within  past  six  months  if  they 
reported  working  on  more  thati  half  of  the  shop  systems  at  a prior 
F-m  base, 
d 

Respondents  apparently  misunderstood  cpiestion.  Number  not 
used  in  computing  average, 
e 

Averages  weighted  for  different  numbers  of  personnel  in  the 
two  work  centers. 
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r.iMc  19  shows  the  major  topics  taught  in  those  two  courses  arul 
the  hours  assigned  to  each.  Note  that  about  a fourth  of  tfie  total  is 
ilirectly  related  to  job  performance  (operational  checkout, 
troubleshooting,  cable  repair,  and  aircraft  wiring).  Of  these  hours, 
nearly  half  are  devotf’d  to  teaching  ot)jectiv<'s  that  are  tested  by 
paper  and  pencil  rather  than  by  actual  performance  on  a trainer  or 
workbench.  Kven  the  li  1 hours  of  training  in  operational  checkout  that 
are  tested  on  a trainer  cannot  continuously  involve  the  student  in 
active  performance  because  not  all  students  can  work  on  the  trainer  at 
once  and  because  the  instructor  uses  the  trainer  to  demonstrate  the 
checkout  procedure  before  students  try  it.'"  Thus  we  may  conclude  that 
less  than  10  percent  of  the  course  hours  involve  the  student  in  active 
performance.  Nevertheless,  Table  14  shows  that  job  incumbents  cited 
the  FTD  as  the  source  of  pertinent  training  for  36  percent  of  the 
actions  taken. 

The  Plan  of  Instruction  exhibits  other  peculiarities.  Cable 
repair,  which  is  highly  job-related  and  was  cit-’d  by  sergeants  and 
staff  sergeants  on  the  TAC  questionnaire  as  needing  more  training 
emphasis,  is  taught  at  Keesler  AFB  and  not  repeated  at  the  FTD; 
certainly  many  trainees  will  have  forgotten  their  training  in  this 
skill  by  the  time  they  start  work.  Another  peculiarity  is  the 
apparent  redundancy  of  instruction  in  applied  theory  of  specific 
systems;  part  or  all  of  the  74  hours  given  this  training  at  Keesler 
AFB  is  repeated  at  the  FTD.  Finally,  no  training  in  integrated 

*bata  provided  by  the  Mountain  Home  FTD  for  the  period 
,January-May  1974  showed  that  the  Comm/KCM  course  produced  an  average 
of  0.1  trainer  hours  per  student  hour  (total  for  all  four  trainers). 
The  51  trainer  hours  shown  in  the  POl  are  17  percent  of  the  total 
hours  for  the  FTD  course. 
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Table  19 

COURSE  HOURS  AND  TOPICS  FOR  INITIAL  TRAINING  FOR  326X2C  AFS 


(Keesler  AFB  and  FTD) 


Topic 

a 

Hours  -22C 

Total  Hours 

Percent  Total 

Orientation 

44 

56 

10 

Maintenance  electronics 

80 

80 

14 

Communication  systems 

fundamentals 

36 

36 

6 

b 

Applied  theory 

74 

233 

41 

b 

Operational  checkout 

Tested  on  trainer 

0 

51 

10 

Not  tested  on  trainer 

0 

4.5 

1 

b 

Troubleshooting  (not 

tested  on  trainer) 

0 

60.5 

1 1 

Cable  repair 

16 

16 

3 

Aircraft  wiring 

6 

6 

1 

Written  tests 

14 

24 

4 

Total 

270 

567 

a 

Number  of  hours  in  Keesler  AFB  course, 
b 

Specific  communication  system. 
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systems  is  designated  at  any  point,  although  we  know  that  at  the  least 
there  are  interactions  among  Comm/ECM  and  Bomb/Nav  systems.  In  fact, 
a number  of  respondents  to  the  TAG  questionnaire  expressed  a need  for 
more  thorough  training  in  systems  integration. 

The  need  for  some  training  in  systems  integration  implies  that 
important  features  of  tlie  Comm/ECM  systems  are  unique  to  particular 
models  of  F-111,  that  is,  that  some  training  specific  to  the  weapon 
system  is  needed.  Therefore,  more  effective  and  efficient  training 
would  result  if  the  Comm/ECM  specialist  attended  ETC  at  the  base  to 
which  he  will  be  assigned  to  duty. 

Thus,  we  see  that  many  of  the  same  problems  found  in  the  Bomb/Nav 
training  course  are  found  in  the  Conun/ECM  course,  despite  the  greater 
opportunity  provided  by  the  FTD  for  job-relevant  training.  The 
practice  of  sending  the  trainee  to  Keesler  AFB  for  fundamentals  and  to 
the  FTD  for  set  school,  however,  has  disadvantages  beyond  the  possible 
redundancy  and  loss  of  coherence  between  the  two  phases.  Each  time 
the  trainee  moves  from  one  phase  to  the  next,  additional  time  and 
money  are  spent,  not  only  during  travel  and  relocation  but  because 
the  trainee  must  often  wait  for  classes  to  form.  Lost  time  is 
not  only  lost  money  but  unused  (and  hence  forgotten)  training.  This 
is  a serious  defect  of  the  two-phase  training  concept. 

We  found  similar  deficiencies  in  training  and  experience  among  7- 
and  9-level  personnel  in  the  Comm/ECM  specialty  as  in  the 
Instrument/Autopilot  specialty,  as  shown  in  Table  20,  but  Comm/ECM 
middle  management  had  the  poorest  record  of  the  three  specialties  in 
formal  training. 
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Tahlo  20 

SELF-RKPOKTKl)  EXPERIENCE  AND  TRAINING  OK  7-  AND  9-EEVEI,S 
IN  THE  COMM/ECM  SPECIALTY 


Percent  of 

Respondents 

Base 

a 

(1) 

With  Work 
on  Less 
than  Half 
of  Systems 
in  Previous 

6 Months 

b 

(2) 

With 

Limited 

F-111 

Exper i ence 

c 

(3) 

With  0.JT 
on  Less 
than  Half 
of  Systems 

(4) 

With  No 

F o rma 1 
Training 
in  326  AFS 

Cannon 

40 

40 

17 

33 

Mountain  Home 
d 

33 

22 

36 

78 

Average 

36 

29 

40 

60 

SOURCE:  Data  on  which  this  table  is  based  are  found  in  Tables 

A-2  and  A-4  in  the  appendix, 
a 

Does  not  include  personnel  assigned  within  previous  six 
months . 
b 

Includes  personnel  who  worked  both  less  than  half  of  the 
systems  during  the  previous  six  months  and  less  than  half  of  the 
systems  during  prior  assignments  to  an  F-111  base,  if  any. 
c 

Includes  personnel  assigned  within  past  six  months  if  they 
reported  working  on  more  than  half  of  the  shop  systems  at  a prior 
F-111  base, 
d 

Averages  weighted  for  different  numbers  of  personnel  in  the 
two  work  centers. 
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RKVISIONS  TO  BOMB/NAV  BASIC  TKCHNICAL  TRAINING 

As  a rt'siill  <>l  loiuprii  about  the  effectiveness  of  representative 
trainin)^,  and  .liter  several  major  conferences,  a meeting  was  held  at 
Lowry  Technical  Training  Center  (April  1-4,  1975)  to  develop  a new 
training  plan  with  two  phases  of  instruction. 

1.  The  prepar.itory  phase  includes  basic  electronics  and  digital 
computer  fundamentals,  basic  radar  principles  and  servo  systems,  use  of 
Air  force  technical  orders,  safety  and  security  regulations,  maintenance 
and  inspection  forms,  principles  of  navigation  and  fire  control,  and 
introduction  to  the  avionics  system  career  field. 

2.  The  second  phase  includes  functional  analysis  of  systems, 
system  integration,  opi-rational  checkout  procedures,  use  of 

organ i za t i ona 1 maintenance  test  equipment,  malfunction  isolation,  and 
removal  and  replacement  of  line  replaceable  units,  as  well  as 
flight-line  safety,  troubleshooting  and  repair  of  aircraft  wiring  and 
connectors,  and  use  of  technical  orders  and  checklists  throughout  the 
course."  It  is  to  he  conducted  at  five  CONUS  FTDs , one  for  each  model 
of  the  F-lll/F-15.  The  individual  FTDs  are  to  develop  POls  and  course 
material  in  accordance  with  the  approved  training  plan. 

Phase  I 

The  new  Phase  I of  basic  technical  training  differs  from  the 
earlier  "maintenance  electronics"  in  that  (1)  several  topics  of 
applied  theory  have  been  added,  (2)  instruction  will  no  longer  be 
self-paced,  and  (3)  basic  electronics  theory  will  be  extended. 

*USAF  Training  Plan,  Course  3AQR32622A-0/4ABF32632A- (X) , approved 
•June  4,  1975. 
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Evaluat^m^of  l^hase  I.  Over  one-third  of  formal  training  in  the 
original  training  program  and  40  percent  in  the  revised  training 
program  are  in  basic  electronics  topics  because  many  Air  Force 
personnel  believe  that  troubleshooting  any  avionics  system,  even  on  the 
flight  line,  requires  mastery  of  traditional  basic  electronics.  They 
believe  that  current  maintenance  problems  stem  from  the  way  the 
fundamentals  course  was  taught  (self-paced  instruction,  with  open-book 
examinations),  which  allowed  men  to  graduate  without  demonstrating  any 
real  knowledge  of  the  subject,  and  from  the  shortness  of  the  course, 
which  permitted  only  a skimpy  treatment  of  a large  range  of  subjects. 
Our  own  examination  confirmed  that  these  were,  in  fact,  deficiencies 
in  the  way  the  course  was  taught,  although  self-pacing  was  not  the 
primary  problem.  Any  teaching  method  would  be  subverted  by  open-book 
testing  designed  to  pass  as  many  students  as  possible  rather  than 
evaluate  mastery  of  subject  material.  Our  analysis,  however,  leads  us 
to  believe  that  the  lack  of  basic  electronics  skills  among  first-term 
airmen  does  not  adversely  alter  the  effectiveness  of  flight-line 
maintenance.  Our  conclusions  are  based  upon  several  facts: 

1.  In  none  of  the  jobs  or  tasks  observed  in  the  job  content 
survey  did  maintenance  technicians  use  any  skills  normally  associated 
with  basic  electronics. 

2.  The  expert  evaluators  of  the  job  content  summaries  confirmed 
that  basic  electronics  skills  were  not  used.  They  also  indicated  that 
few  of  the  basic  electronics  topics  currently  taught  in  technical 
school  were  needed  either  on  the  job  or  as  a base  for  future 


instruction. 
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3.  The  list  ol  basic  electronics  topics  taught  in  technical 
school  was  also  reviewed  by  a senior  General  Dynamics  Technical 
Representative  assigned  to  flight- line  duty  at  Cannon  AFB.  He  felt 
that  a majority  of  topics  were  not  relevant  to  the  job.  On  a topic  by 
topic  basis,  he  indicated  that  needed  material  could  be  covered  in  2.3 
weeks,  compared  with  5.4  weeks  in  the  old  Lowry  AFB  course  and  6.3 
weeks  in  the  new  Lowry  AFB  Phase  I course.  Several  of  the  new, 

.applied  theory  topics  he  thought  should  be  of  value. 

4.  A review  of  the  General  Dynamics  FIVP  data  showed  that  "no 
known  maintenance  action  justifies  use  of  breakout  boxes"  and  thus  an 
oscilloscope,  thereby  largely  precluding  the  application  of  basic 
electronics  to  the  flight  line. 

5.  The  majority  of  respondents  to  the  TAC  questionnaire  argued 
that,  "in  this  job  we  do  not  use  basic  electronics."  To  put  it  more 
strongly,  and  in  the  words  of  one  technician  at  Cannon  AFB, 


Actually,  it  [electronics  fundamentals]  was  a waste--not  that 
the  training  itself  is  at  fault,  but  rather  the  career 
field.  Electronics  is  not  utilized.  |We]  went  too  deeply 
into  wiring  diagrams,  etc.,  for  doing  this  job.  Somebody 
evidently  is  still  pretending  that  the  326X2A  career  field 
involves  electronics,  and  it  doesn't.  No  more  so  than 
turning  on  a light  switch  would  involve  working  on  a 
generator . 

6.  The  conclusion  that  basic  electronics  is  not  used  on  the  job 
is  supported  by  the  findings  of  an  independent  review  by  a member  of 
Rand's  engineering  staff  of  the  flight-line  job,  technical  orders,  and 
training  material.* 

*See  Richard  E.  Duren,  AProposed  ^oi^se  for  Avionics 
Technicians , R-2049-AF,  The  Rand  Corporation. 
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The  press  for  more  hasie  eleetroriies  training  eam<'  primarily  tram 
senior  personnel  who  were  mainly  transfers  from  other  career  fielils. 
Apparently,  they  were  heavily  influenced  by  their  own  past  training 
and  experience  on  other,  less  advanced  avionics  systems.  The  desire 
to  expand  basic  electronics  was  far  from  universal,  however.  For 
example,  one  technical  sergeant  assigned  to  the  F- I S test  sipiadron  at 
Fdwards  AFB  noted  that  "career  electronics  technicians  who  are 
involuntarily  retrained  into  this  AFSC  (32672C)  are  grossly 
overmatched  to  the  reipii  rements  of  this  job.""'  Another  claimed  that 
after  being  assigned  from  a 32.S70A  "they  had  to  detrain  me  to  work  in 
this  career  field.""'" 

Traditionally,  electronics  has  been  highly  regarded  as  a 
difficult  career  field.  The  advent  of  LRUs  and  automatic  test 
stations  has  tended  to  debase  the  glamour  of  the  advanced  avionics 
career  fields.  One  way  to  fight  the  realities  of  flight-line 
maintenance  on  an  integrated  digital  system  is  to  continue  to  insist 
upon  a rigorous  course  in  basic  electronics,  whether  it  is  needed  or 
not.  For  example,  one  7-level  technical  sergeant  from  the  Bomb/Nav 
shop  at  Cannon  AFB  argued  that  new  airmen  were  "not  adequately 
instructed  in  the  fuiulamenta 1 s of  electronics."  However,  he  also  noted 
that,  "a  trained  monkey  could  perform  this  function....  If  he  is 
unlucky  enough  to  be  assigned  to  the  ,326X2  area  he  will  get  little  or 
no  chance  to  apply  his  native  intelligence.  At  least  the  326X1 
(intermediate  avionics  maintenance  shop|  gets  to  use  more  electronics 

■*For  example,  the  current  Bomb/Nav  3-level  training  is  18  weeks 
long.  The  average  7-level  had  a i»0-week  basic  course  when  he  entered 
the  Air  Force,  a large  portion  of  which  dealt  with  basic  electronics. 

vVArThe  above  and  subsequent  quotations  in  this  section  are  from 
the  TAG  Supervisory  Questionnaire. 


in  Lheir  ma  i iitenance  . " 
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In  another  rase,  a senior  Bomb/Nav  shop 
supervisor  noted  on  the  TAG  (pjestionnai re  that  the  Air  Force  should 
"teach  the  new  people  that  are  coming  into  this  field  the  basic 
electronics  that  is  required  for  the  most  part  in  all  electronics 
fields.  The  basic  knowledge  that  was  taught  twenty  years  ago  and  is 
still  valid."  In  a subsequent  interview,  the  supervisor  was  unable  to 
indicate  specific  instances  when  knowledge  of  basic  electronics  theory 
was  applied.  In  essence,  his  response  was,  "How  can  these  people  be 
considered  electronic  technicians  if  they  don't  know  any  electronics?" 
By  contrast,  another  supervisor  at  Mountain  Home  AFB  argued  that 
"People  naturally  resist  change.  That's  the  problem  with  the  T26XXX 
career  field  now.  The  test-station-repaired  LRU  concept  is 
maintenance  of  the  future.  The  (juicker  everyone  works  towards  this 
goal  the  better." 

The  desire  for  rigorous  training  in  basic  electronics  lor  status 
or  other  nonjob-related  reasons  was  also  given  in  the  responses  of  two 
supervisors  from  the  474th  Tactical  Fighter  Wing.  One  argued  that 
"Graduates  are  not  able  to  pass  a basic  electronics  course.  They  will 
be  handicapped  during  their  promotion  testing."  The  other  wanted  "more 
basic  electronics  if  it  is  going  to  be  kept  in  the  SKT  testing."  This 
certainly  puts  the  cart  before  the  horse.  Insisting  on  a rigorous 
course  in  basic  electronics  or  an  impressive  AFM  39-1  job  description 
will  not  change  the  realities  of  the  job.  In  fact,  it  builds  false 
expectations . 

Phase  1 1 


The  Phase  II  concept  and  the  use  of  the  FTl)  as  an  alternative  to 
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the  present  centralized  technical  school  training  have  several 
advantages  and  disadvantages.  Because  of  their  proximity  to  the 
flight  line,  FTDs  are  better  able  to  maintain  relevant  course  content. 
It  is  easier  for  instructors  to  visit  the  work  centers  to  observe  the 
latest  techniques  in  job  performance  and  to  find  out  what  shop 
supervisors  need  in  terms  of  special  training  for  their  personnel.  A 
particularly  important  plus  for  the  FTD  is  that  the  instructors  are 
often  drawn  from  personnel  who  have  had  considerable  experierce  in  the 
operating  unit  and  with  the  equipment  that  the  FTD  supports.  Thus, 
they  are  more  likely  to  know  which  sections  of  the  technical  orders  to 
stress,  to  know  from  experience  how  to  fill  in  where  the  technical 
orders  are  deficient,  and  in  general  to  draw  from  working  expertise  in 
their  teaching. 

Finally,  in  the  F-111  program  the  bench  trainers  at  the  FTDs  are 
more  realistic  than  those  at  technical  school.  Moreover,  trainer 
downtime  because  of  spare  part  shortages  can  be  less  of  a problem  for 
the  FTD  than  it  is  for  the  technical  school  because  the  operating  unit 
may  make  spares  available  or  allow  FTD  instructors  to  conduct  training 
on  equipment  from  the  operating  inventory. 

FTDs  encounter  some  management  problems,  primarily  in  inefficient 
use  of  training  resources  and  scheduling  difficulties.  Because  they 
are  so  scattered,  student  loads  at  FTDs  are  typically  lower  than  at 
technical  school  and  economies  of  scale  are  hard  to  achieve.  For 
example,  in  the  period  from  September  1,  197.3,  through  May  31  , 1974, 
avionics  instructors  in  Cannon's  FTD  7-leveI  avionics  course  averaged 
39  percent  of  the  hours  an  ATC  instructor  is  normally  expected  to 
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spend  in  the  classroom;  comparable  instructors  at  Mountain  Home  AKB 
averaged  somewhat  more--50  percent.* 

Replacing  technical  school  with  FTl)  training  is  most  efficient  ii 
the  student  is  trained  at  his  duty  base.  The  inability  to  predict  the 
base  of  ultimate  assignment  caused  some  32632C  students  to  be  trained 
at  an  FTD  on  a particular  set  of  equipment  and  then  to  be  assigned  to 
a different  base,  thus  negating  some  of  the  benefits  of  FTD  training. 
Moreover,  in  the  case  of  32632C  training  students  first  attended 
resident  technical  school  at  Keesler  AFB  (Phase  I)  and  often 
experienced  delays  between  the  end  of  the  Keesler  course  and  the  start 
of  the  FTD  course  (Phase  II).  There  were  frequent  comments  in  the  TAC 
questionnaire  about  the  advantages  of  moving  the  Keesler  course  to  the 
FTD,  which  would  eliminate  one  move,  i.e.,  combine  both  phases  at  the 
FTD. 

Current  experience  with  FTD  training,  both  the  3-level  extension 
of  technical  school  for  32632C  and  the  7-level  orientation  training, 
is  mixed.  Despite  its  proximity  to  the  Avionics  Maintenance  Squadron 
and  the  flight  line,  the  FTD  can  also  have  problems  of  separation  from 
the  job.  For  example,  although  the  bench  trainers  available  in  the 
rTDs  comprise  equipment  used  in  the  associated  unit,  the  bench  trainer 
often  does  not  duplicate  iaiportant  features  of  the  operating 
equipment,  such  as  the  location  of  various  LRUs  on  the  aircraft. 
Separation  of  equipment  into  different  bench  trainers  (e.g.,  the  TFR 
trainer  is  separated  from  the  INS/DCC/ARS  complex  in  Plattsburg's  FTD) 
further  heightens  the  unreality  of  the  trainers  and  is  especially 
undesirable  for  teaching  integrated  avionics  systems.  Avionics 


*Derived  from  figures  provided  by  Cannon  and  Mountain  Home  FTDs. 
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personnel  nee<l  to  learn  how  the  syslemh  aiisif(neii  to  other  shops  will 
alfert  their  own  systems  in  various  modes,  as  well  as  how  their  own 
systems  are  interrelateil. 

KTl)  instructors  and  students  rarely  have  access  to  actual 
aircraft  and  never  use  real  malfunctions  as  opportunities  fur 
training.  Although  the  use  of  bench  trainers  on  which  malfunctions 
can  he  simulated  is  a more  efficient  training  techni<|ue,  opportunities 
to  work  on  actual  aircraft  early  in  training  do  help  to  motivate  the 
trainee.  A more  serious  problem,  however,  is  that  it  is  difficult  for 
FTD  instructors  to  avoid  becoming  isolated  from  the  real-world  joli 
situation.  It  is  usual,  for  example,  for  an  F'TD  instructor  to  have 
been  in  his  present  duty  for  several  years  and  to  have  lost  direct 
contact  with  the  day-to-day  job.  The  physical  demands  of  F'TD  duty, 
like  those  of  technical  school,  are  considerably  less  than  those  of 
the  flight  line,  and  opportunities  for  self-direction  are  greater. 

This  makes  FTD  duty  quite  attractive  and  encourages  a person,  once 
assigned  to  F'TD,  to  want  to  remain  there.  FTD  instructors  are  often 
viewed  with  a mixture  of  envy  and  scorn  by  those  left  behind  on  the 
job,  and  it  takes  an  aggressive  and  hard-working  person  who  is  willing 
to  put  in  extra  hours  to  maintain  his  practical  expertise.  It  is 
easier  for  him  to  continue  to  teach  the  same  things  he  taught  in  the 
past  and  to  put  more  and  more  emphasis  on  the  theoretical  aspects  of 
the  course,  which  are  both  more  accessible  to  him  and  more  interesting 
intellectually.  Thus,  the  quality  of  training  offered  in  an 
individual  FTD  course  is  highly  dependent  on  the  initiative  and 
inclinations  of  the  instructor.  It  is  not  surprising,  then,  for  one 
FTD  course  to  be  strongly  supported  by  the  user  while  another  is 
condemned  as  irrelevant. 
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I'h.isc  II  Training  al  Nclliti  an<l  Platlshurg  I-TDk  . In  Septt>iBl><*r 
an<l  Ui'lolirr  197^,  wt'  visilcil  th<‘  wiiiks  ainl  KTDs  at  Nrllis  (F-lllA)  and 
PlatlsbiirK  (KB-IIIA)  Air  Korn-  BaKPS  to  learn  how  Phase  II  instruction 
will  he  carried  out  (as  ol  early  197b  no  students  had  entered  Phase 
II).  The  Phase  II  course  at  both  Nellis  and  Plattshurg  ATBs  closely 
adheres  to  the  structure  of  the  approved  ATC  training  plan  in  terns  of 
topics,  sequence,  and  the  amount  of  time  devoted  to  specific  units  of 
instruction.  This  means  that,  as  in  the  basic  Lowry  APB  Bomh/Nav 
course,  components  of  the  integrated  system  will  he  taught  separately, 
one  after  another,  with  "systems  integration"  as  a final  topic.  In 
spite  of  its  location  on  the  operating  bases,  no  instruction  will  be 
given  in  cockpit  familiarization  or  the  removal  and  installation  of 
LRUs.  PTD  personnel  at  both  bases  told  us  that  the  new  Phase  II 
courses  would  be  drawn  from  the  7-level  familiarization  course. 

Based  upon  our  visits  to  Nellis  and  Plattsburg  AFBs , we  conclude 
that  the  KTDs  have  not  taken  full  advantage  of  their  on-base  location 
to  ensure  the  relevance  of  Phase  II  instruction.  We  were  told  by  both 
AMS  and  FTD  personnel  at  the  bases  that  there  had  been  no  input  from 
the  wing  to  the  design  of  the  course,  although  it  would  be  most 
helpful.  Moreover,  aircraft  from  the  operating  inventory  will  not  be 
made  available  to  augment  training  even  though  local  bench  tra.ners 
fail  to  simulate  many  important  interactions  of  the  integrated 
avionics  system. 

Analysis  of  the  Nellis  and  Plattsburg  POIs  reveals  a difference 
in  emphasis  on  job  performance.  At  Plattsburg  AFB,  96  percent  of  the 
instruction  emphasizes  training  objectives  whose  mastery  will  be 
tested  on  the  bench  trainer.  This  compares  with  64  percent  at  Nellis 
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AKB.  Analysis  of  circuit  schematics  is  included  at  Nellis  hut  not  at 
FlattshurK-  In  sum,  we  are  left  with  the  impression  that  Phase  II 
training  at  Nellis  AKB  will  be  somewhat  less  job  relevant  than  it  will 
be  at  Plattsburg  AKB. 

Evaluation  of  Phase  II.  The  advent  of  Phase  II  instruction  at 
the  local  KTD  presents  a great  opportunity  to  develop  job-relevant 
training.  The  foregoing  discussion  illustrates,  however,  that  the  job 
relevance  of  the  training  the  FTDs  will  provide  is  variable.  Even  the 
different  Plans  of  Instruction,  which  certainly  cannot  reflect  the 
subtleties  of  variations  in  the  job  proficiency  of  the  instructors, 
demonstrate  this  variability. 

The  new  32632A  training  program  still  suffers  from  many 
deficiencies  of  the  old  technical  school  course.  Not  only  has  basic 
electronics  been  unnecessarily  expanded,  but  the  shift  of  set  school 
to  the  FTDs  has  not  ensured  job  relevance.  In  fact,  the  new  curricula 
for  the  Phase  II  courses  have  been  derived  from  old  courses  and 
existing  training  equipment  without  a job  content  analysis  and,  in 
most  cases,  without  active  participation  in  the  details  of  course 
design  by  experts  in  job  performance.  Only  the  latter  kinds  of 
procedures  ran  assure  that  what  should  be  taught  is  taught  and  what 
should  not  be  taught  is  not,  and  that  training  is  both  effective  and 
ef'  nt. 

iming  of  training  still  suffers  from  the  "fundies  first, 
sets  second"  philosophy.  Early  experience  on  the  job  can  motivate  the 
individual,  give  him  a general  understanding  of  the  operating  modes  of 
the  avionics  system,  and  help  him  understand  the  relevance  of  more 
abstract  topics.  In  particular,  an  individual  should  not  be  trained 
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in  troubleshooting  before  he  has  ever  removed  or  installed  an  LRU  from 
the  aircraft  or  run  an  operational  check  in  the  cockpit.  Hany 
flight-line  personnel  have  expressed  a desire  for  a better  working 
knowledge  of  system  operation  before  being  trained  in  troubleshooting. 

Finally,  although  the  move  of  set  school  to  the  FTDs  has 
undoubtedly  alleviated  major  problems  associated  with  the  Lowry  AFB 
training  equipment  and  instructors,  there  are  still  deficiencies  in 
training  equipment  at  the  FTDs.  Moreover,  except  tor  the  Phase  II 
course  at  Cannon,  which  is  discussed  below,  trainees  will  continue  to 
have  to  wait  for  the  award  of  their  3-level  before  they  have  realistic 
experience  on  operating  aircraft.  Variability  of  job  profi  iency  of 
FTD  instructors  will  continue  to  result  in  variability  in  the 
relevance  of  the  training  they  provide.  An  effective  mechanism  for 
linking  training  to  the  job  is  needed  to  make  sure  of  the  relevance 
and  efficiency  of  training. 

THE  TASK  ORIENTED  TMIN INC  PROGRAM 

As  an  alternative  to  the  traditional  technical  school/FTD 
training,  TAC  initiated  the  Task  Oriented  Training  program.  TOT 
directly  addresses  the  content,  timing,  and  location  of  training. 

While  not  directed  at  entry-level  technical  training,  it  has  major 
implications  for  the  conduct  of  Phase  II  training  at  the  FTDs.  The 
objective  of  the  TOT  program  was  to  provide  more  effective  practical 
training  to  TAC  maintenance  personnel.  TAC  couched  this  goal  in  terms 
of  "improvement  of  the  FTD/OJT  interface": 


In  order  to  enhance  the  quality  of  TAC's  maintenance 
training  and  insure  its  efficiency,  TAC  and  ATC  are 
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imp  loRM'iit  iDK  ■>  tr.iiniiiK  proKram  tiy  bluih  K'l'l)  tr.iiiiiiiK  will 
(omplcmnil  tlif  pr.utiiMl  (li.iiiiicl  ol  O.IT  by  provi<liiif(  task  or 
job  oriiMitril  Iraiiiiiix.  Task  urKMitol  IraiiiiiiK  will  Icacli  a 
man  the  kiiowliMlgi-  ami  skills  iii‘i'<‘ssa  ry  to  pcrlorm  spot  it  ii 
tasks  that  art<  r(*<|ti i riol  in  bis  ciirriMit  job  ass i KiiowMit . Tins 
pro(;ram  will  prodiici*  mon*  tapablc  graduates  in  a shorter 
amount  ol  time  who  are  able  to  perlorm  the  duties  reipiired 
by  their  supervisors.  This  will  rediut*  the  trainiiiK  burden 
on  supervisors  ami  tomplement  the*  <(Ua  I i ( i t at  i on  reijui  ri'flients 
of  the  OJT  practiial  thannel.* 


In  fact,  the  implementation  plan  stated  that  "task  orientiot  courses 
are  designed  to  replace  existing  courses  in  each  ri‘spectiv«"  AKSC . "** 

TOT  requires  close  interaction  between  wing  personnel  ami  the 
local  FTl).  For  ex.imple,  a Plan  of  Inslruction  is  written  jointly  by 
Maintenance  Training  Management  ami  FTl)  personnel  and  submitted  to  Hq 
ATC  in  ilraft  form  for  review  and  approval.***  (lourses  are  also  ronducte<l 
as  a joint  ATC/TAt  effort.  FTD  personnel  conduct  all  academic 
training  and  some  practical  training,  if  so  specified  in  the  POI. 

Academic  training  on  a specific  task  precedes  practical  training.  Thi* 

FTD  instructor  may  be  assisted  in  the  practical  phases  of  instruction 
by  a TAG  Instructor  Augmentee,  a job-qualified  person  assigned  to  the 
TOT  course  by  the  wing's  Deputy  Commander  for  Maintenance.  The  TAG 
Augmentee  conducts  whatever  practical  training  the  FTD  cannot  conduct 
and  signs  off  maintenance  actions  taken  on  operational  equipment,  if 
sign-off  is  required  and  the  FTD  instructor  is  not  qualified  to  do  so. 

The  POI  identifies  these  requirements,  in  addition  to  requirements  for 
the  presence  of  a TAG  technician  for  specific  tasks,  such  as 

^Headquarters  TAG,  Implementation  an Task  ^ri^ted  T^rain^ng 
Program; Tac-Wide , March  1975,  p.  1. 

**Implementation  Plan,  p.  A. 

***Much  of  the  following  discussion  was  drawn  from  Hq  TAG, 

Proposed  Regulation,  TAG  50-XX  XX,  May  1975  (unpaged). 
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I ii-)iroi'i‘ss  I n.s|)<-('t  I Otis  . Final  t crt  i I i i al  i on  oi  tin*  slinlt'iit's  job 
l>r()l  ii'ii'iu  y rt'm.iins  the-  rosponsihi  I ity  of  shop  manaxc'mcnt  pi‘ri>onn(>l  . 

Ma  I nlt’iiaiu  o Training  ManaKcntfiil  is  rosponsihle  lor  m.inaKiiiK  tilt* 
T.isk  OriiMiliMl  Training  prof^ram  ami  roor<i i nal  i iiK  with  othi'r  agencies  as 
neeileit.  An  individual  in  the  Management  section  monitors  all  TOT 
courses  and  schedules  courses,  resources,  and  students.  M.iintenance 
Training  Management  also  <levc‘lops  a flow  chart  for  local  course 
management  that  shows  the  sequence  in  which  each  portion  of  a course 
will  be  taught,  identifies  requirements  tor  equipment,  and  sets  forth 
the  utilization  of  FTD  and  TAG  instructors. 

Responsibility  for  determination  of  the  training  needed  by 
specific  individuals  remains  with  shop  supervisors.  They  identify 
personnel  who  require  FTD  training  to  Maintenance  Training  Management 
and  determine  when  an  individual  should  return  to  FTD  for  advanced 
training.  "It  is  the  intent  of  this  program  that  entry  level 
graduates  attend  the  advanced  course  five  to  eight  months  after 
graduation . "* 

The  most  significant  feature  of  the-  TOT  program  is  that' TAG 
commits  its  own  aircraft,  equipment,  and  personnel  to  be  used  for 
hands-on  training  and  that  these  comnitments  are  included  in  formal 
course  documentation.  This  commitment  requires  the  MAJGOMs  to  "devise 
scheduling  procedures  to  incorporate  training  course,  aircraft, 
equipment  and  personnel  requirements  into  monthly  and  weekly  published 
utilization  schedules."**  "It  is  incumbent  upon  wing  commanders  and 

'^Implementation  Plan,  p.  6. 

^'*Headquarter8  TAG,  ATC/TAG  Task  Oriented  Training  Report, 
February  1975,  p.  A. 
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Deputy  Comnanders  for  Maintenance  to  ensure  that  aircraft  and 
equipment  are  provided  when  required  to  meet  trainiriK  needs.***  This 
is  a major  step  toward  breaking  the  barriers  between  training  and 
using  organizations. 

The  TOT  program  did  not  originally  include  the  326  career  field. 
In  July  1973,  teams  were  established  at  Luke  and  Davis  Monthan  AFBs  to 
test  the  application  of  TOT  to  the  aircraft  maintenance  (431XIC)  and 
egress  specialties.  "Test  evaluations  indicated  that  many  benefits 
could  be  achieved  by  employing  ...  (TOT)  procedures,**  according  to  the 
implementation  plan.**  TAG  and  ATC  then  agreed  to  work  jointly  to 
apply  the  TOT  concept  to  FTD  courses  in  the  aircraft  maintenance, 
engine  (432X0),  and  pneudraulics  (421X1)  specialties.  Four  prime 
sites  were  selected  on  July  6,  1974:  Little  Rock,  Davis  Monthan, 
Cannon,  and  Seymour  Johnson  AFBs. 

Both  entry-level  and  advanced  FTD  courses  were  developed.  The 
entry-level  course  was  for  personnel  with  no  previous  experience  on 
the  weapon  system,  which  differs  from  the  usual  situation  in  which  the 
FTD  offers  only  a single  advanced  course  that  is  sometimes  given  to 
both  experienced  and  inexperienced  personnel.  Some  courses  designed 
for  a given  level  were  broken  down  still  further  so  that  training 
could  be  tailored  to  the  specific  needs  of  the  individual  and  the 
using  organization.  This  approach  recognized  the  often  specialized 
nature  of  assignments  within  shops.  We  illustrate  such  a modularized 
approach  to  course  design  when  we  discuss  Task  Oriented  Training  in 
the  326X2A  career  field  developed  at  Cannon  AFB. 

♦Proposed  Regulation . 

♦♦Implementation  Plan,  p.  2. 
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Late  in  1974,  a nuatber  o|  evaluations  were  made  of  the  TOT 
courses  that  iiad  been  implemented.  One  evaluation,  conducted  by 
Quality  Control  personnel,  was  of  the  ability  of  TOT  graduates  to 
perform  specific  tasks.  (Similar  evaluations  of  shop  personnel  are 
routinely  conducted  by  trained  evaluators  under  the  Maintenance 
Standardization  and  Kvaluation  Program  (MSSP).)  No  discrepancies  in 
task  performance  were  noted  for  35  3-level  graduates  at  Seymour 
Johnson  AFB.  "It  is  significant  to  note  that  graduates  of  former  ITD 
courses,  which  were  not  'task  oriented,'  were  not  capable  of  being 
immediately  administered  NSEP  evaluations  due  to  the  fact  that  they 
were  taught  system  orientation  versus  task  orientation."* 

A questionnaire  was  administered  to  about  12  Cannon  AFB 
supervisors  of  39  graduates  of  the  aircraft  maintenance  and 
pneudraulics  courses.  The  results  appear  below. 


KNOWLEDGE  AND  PROFICIENCY  OF  TOT  GRADUATES  COMPARED 
WITH  FTD  GRADUATES,  AS  RATED  BY  SUPERVISORS 

(Percent) 


TOT 

TOT 

TOT 

Greater 

Same 

Less 

Job  knowledge 

74 

26 

0 

Job  proficiency 

77 

23 

0 

*MinuteB  of  January  21-23,  1975,  Task  Oriented  Training 
Conference,  p.  1. 
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In  200  i^railiidl (*K  ot  si‘V(>ral  it>uri><‘K  at  Cannon  AKH  wcrf  askiMt 

to  rate  their  training.  Their  responses  are  snmnar i/eil  helow. 

HOW  TOT  GKADIIATKS  RATK  COURSK  CHARACTKRISTICS 
(Percent  of  Kraduates) 


Course 

Characterist ic 

Kxiel lent 

Gou<l 

Unsat i s 1 actory 

Subject  matter 

70 

30 

0 

Training  aids 

70 

20 

10 

Training  method 

75 

25 

0 

Learning  environment 

70 

25 

5 

An  interesting  fallout  of  the  TOT  program  at  Little  Rock  AFB  was 
noted  in  the  minutes  of  a January  1975  TOT  conference.  In  the  process 
of  developing  the  courses,  approximately  100  AFTO  22  forms  were 
submitted.  It  appears  that  involving  field  personnel  in  the 
preparation  of  training  materials  resulted  in  improvements  in  the 
technical  orders  themselves. 

The  TOT  Cc^rse  in  the  326X2A  Field  at  Cannon  Air  Force  Base 
Although  the  original  TOT  plan  did  not  include  avionics 
specialties,  the  wing  commander  at  Cannon  AFB  asked  Hq  TAC  to  include 
Cannon’s  326X2A  specialty  in  the  TOT  schedule.  In  mid  1974, 
Maintenance  Training  Management  personnel,  using  specialists  assigned 
from  Avionics  Maintenance  Squadron,  undertook  an  intensive  effort  to 
design  a task-oriented  course  for  32652A.  Their  preliminary  plan, 
illustrated  in  Fig.  4,  took  the  imminent  move  of  the  Lowry  AFB  set 


Lowry  Technical 
Training  Cenfer 


Fundamentals 

and 

principles 


Course : 

3ABR326X2A 


8S 


TOT/FTD  Canrxsn  AFB 


Fig. 4 


Cannon  Air  Force  Base  Bomb/Nav  training  sequence  proposed 
by  Maintenance  Training  Management,  Fall  1974 
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school  lo  l*’o  KI'Ds  .IS  .1  point  ol  tiopartiirc . Tlioy  proposoil  ih.il 
instoad  ot  Iho  I r.niit  lon.il  sot  sthoul  portion  oi  'i~lovol  tochiiical 
school,  students  ho  .issiKHod  directly  to  a ono-wook  TOT  course  alter 
taking  the  course  in  1 uiidamentals  and  principles  at  Lowry  AFB.  This 
course  would  teach  removal  and  installation  ol  LHUs  on  aircralt,  alter 
which  the  trainee  would  perform  these  tasks  on  the*  line  for  six  weeks. 
The  trainee  would  then  return  to  Task  Oriented  Training  to  learn  to 
operate  and  operat ion.i  1 1 y check  the  avionics  systems,  again  working  on 
aircraft.  .Subsequent  e'xperience  on  the  line  would  prepare  him  for  the 
final  phase  of  the  course,  troubleshooting  and  rep.iir  ol 
mal I'lnct inning  avionics  systems,  where  the  malfunctions  would  he 
supplied  by  aircralt  in  the  operating  inventory. 

One  important  feature  ol  this  proposal  was  the  movement  ol  the 
trainee  between  training  anil  job  experience,  which  would  immediately 
reinforce  training  with  actual  job  practice,  make  the  trainee  a 
positive  asset  to  the  line  in  a very  short  time,  whet  his  appetite  for 
further  training  by  making  him  aware  of  deficiencies  in  his 
preparation,  and  make  it  easier  for  him  to  understand  more  advanced 
training  topics.  Another  important  feature  was  the  proposal  that 
practical  training,  including  some  troubleshooting,  be  carried  out  on 
aircraft  from  the  operating  inventory.  Although  this  is  not  always 
the  most  efficient  use  of  resources,  it  certainly  is  a promising 
approach  for  the  early  stages  of  training,  when  orientation  and 
motivation  toward  the  job  are  being  established,  and  provides  a 


realistic  appreciation  of  troubleshooting  problems. 


R7 

While  waiting  tor  Air  Training  Comniand's  decision  on  the 
restructuring  ot  !)-level  training.  Maintenance  Training  Management  at 
Cannon  AFB  implemented  in  January  1975  a mociified  and  drastically 
shortened  version  of  their  original  proposal,  as  shown  in  Fig.  5. 
Graduates  at  the  3- level  from  Lowry  AFB  entered  the  first  phase  of  TOT 
to  learn  to  remove/ insta 1 1 LRUs  on  aircraft  from  the  operating 
inventory.  They  next  were  taught  to  operate  and  operationally  check 
systems  on  aircraft  before  they  went  to  the  line.  (This  segment  was 
reduced  from  six  weeks  to  two.)  They  were  scheduled  to  attend  the 
course  in  troubleshooting  and  repair  after  six  weeks  of  experience  on 
the  job.  Note  that  the  troubleshooting  block  was  reduced  from  six 
weeks  to  about  two  and  one  half  weeks.  Newly  arrived  5-  and  7-level 
personnel  were  also  scheduled  to  take  the  portions  for  troubleshooting 
and/or  operating  and  operationally  checking  at  the  discretion  of  the 
shop  chief. 

Between  January  and  May  1975,  26  students  completed  the  five-week 
course.  One  TAG  instructor  did  most  of  the  teaching,  supported  by 
another  TAC  individual  who  assisted  in  the  preparation  of  course 
materials  and  in  the  practical  phases  of  instruction. 

The  Cannon  TOT  courses  were  given  in  a hangar  dedicated  to  the 
program.  Two  aircraft  with  maintenance  problems  (of  a type  that  would 
not  interfere  with  the  instruction  during  the  week)  were  scheduled  into 
the  hangar  for  a week  at  a time.  Required  maintenance  was  performed 
outside  of  scheduled  training  time  through  coordination  with  Job 


Control . 


KK 


Cannon  AFB 


Fig.  5 — Cannon  Air  Force  Bose  Bomb/Nov  maintenance 
training  implementation,  January  1975 
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Tht*  most  fiiroft  cv  i we  obtained  on  Hie  e 1 1 ei  1 1 veness  ol  the 

TOT  training  in  avionics  came  from  liisciissioiis  witii  two  Homb/Nav  shop 
supervisors  who  were  familiar  with  both  the  TOT  graduates  and 
graduates  ot  the  KTD  course.  Both  supervisors  agreed  that  thi*  TOT 
graduates  were  more  knowledgeable  about  hardware,  more  aware  of 
aircraft  lunctions  ami  cockpit  indicators,  ami  better  at  performing 
operational  checks.  In  addition,  they  could  remove/ i nsl a I 1 l.KUs 
without  supervision,  whereas  KTD  graduates  could  not. 

Significantly,  the  supervisors  had  different  expectations  of  the 
relative  abilities  of  the  TOT  and  FTD  graduates  to  troubleshoot 
malfunctions.  One  felt  that  both  groups  would  be  eipially  deficient 
because  of  inadequate  training  in  basic  electronics.  The  other 
believed  that,  even  though  the  old  FTD  course  was  "way  too  long,"  it 
produced  a better  troubleshooter  because  it  went  more  deeply  into  the 
inner  circuitry  of  the  LRUs.  This  disagreement  about  the  content  of 
training  desirable  for  troubleshooting  gives  further  evidence  of  the 
inability  of  some  supervisory  personnel  to  identify  precisely  the 
knowledge  required  for  troubleshooting  advanced  avionics. 

Uniq^ue  Features^  of  ^h^  TOT  Program  Cannon  Ai  r Force  Base 

Although  we  were  not  able  to  visit  all  of  the  TOT  programs  in 
TAC,  we  noted  differences  between  their  implementation  at  Cannon  AFB 
and  the  policy  set  forth  in  the  original  implementation  plan,  as  well 
as  the  implementation  at  some  other  sites.  The  most  obvious 
difference  was  in  the  relative  roles  played  by  Maintenance  Training 
Management  and  the  FTD.  At  Cannon  AFB,  Maintenance  Training 
Management  played  a dominant  role.  As  a result,  the  hangar  and  AGF 
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w»*rp  (ledicatptl  to  the  program,  whereas  the  official  plan  merely  sLate<l 
that  TOT  units  would  share  hangars  and  AGK  as  available.  At  one  site, 
where  Maintenance  Training  Management  was  relatively  weak, 
difficulties  in  obtaining  aircraft  for  the  pneiidraul i cs  course 
stretched  the  course  length  from  76  to  133  hours.  At  Cannon  AFB, 
students  completed  the  courses  on  time  even  when  it  was  difficult  to 
find  airframes  to  support  the  flying  schedule. 

Another  significant  difference  was  that  the  implementation  plan 
left  the  selection  of  students  for  the  TOT  program  up  to  shop 
management,  but  at  Cannon  AFB  a Maintenance  Training  Management 
representative  met  with  each  new  person  and  scheduled  training 
requirements  with  the  person's  work  section.  To  complete  all  training 
requirements  as  rapidly  as  possible,  the  person's  previous  training 
was  compared  with  the  needs  of  the  work  center,  and  a personal 
schedule  of  required  training  was  constructed. 

The  implementation  plan  stated  that  "ATC  will  retain  full 
responsibility  for  managing  all  media  requirements.  Existing  ATC 
policies  and  procedures  are  adequate  to  cover  media  development, 
standardization  and  update."*  Despite  this,  the  TOT  program  at  Cannon 
AFB  was  supported  by  an  in-house  capability  to  develop  and  produce 
training  media.  This  is  particularly  important  for  training  programs 
that  must  be  highly  responsive  to  local  needs.**  In  addition,  Cannon 
AFB  was  able  to  handle  special  one-of-a-kind  courses  and  low-flow 
courses  by  using  media  to  fill  in  for  instructors. 

*Headquarters  TAC,  ATC/TAC  Task  Oriented  Training  Report, 

February  197!i,  p.  3. 

*‘’‘Training  media  include  films,  sound-on-slide  sets,  and  other 
nonprinted  materials.  Media  produced  through  official  ATC  procedures 
are  expensive  and  can  take  over  a year  to  obtain. 


91 


Finally,  although  the  implementation  plan  required  that  only  part 
of  the  time  of  a maintenance  officer  be  set  aside  for  monitoring  and 
managing  the  TOT  program,  at  Cannon  AFB  a lieutenant  colonel  spent 
full  time  on  the  program.  He  was  supported  by  a full  clerk  and  with 
four  TAG  personnel  from  different  AFSCs  assigned  to  temporary  duty. 

These  differences  are  evidence  of  the  emphasis  placed  on  the  TOT 
program  by  the  Cannon  wing  commander.  As  stated  in  the  implementation 
plan,  a key  to  success  of  the  program  is  the  working  relationship 
between  Maintenance  Control  (Plans  and  Scheduling  and  Job  Control)  and 
Maintenance  Training  Command.  The  head  of  the  TOT  program  needs 
sufficient  rank  to  have  leverage  in  his  dealings  with  Maintenance 
Control,  requiring  the  wing  commander  to  dedicate  high-quality 
resources  (particularly  people)  to  support  the  program. 

Seen  solely  as  a substitute  for  either  the  traditional  FTD  or 
OJT,  the  Task  Oriented  Training  approach  can  be  both  more  effective 
and  more  efficient  in  the  use  of  training  resources.  The  TOT  effort 
has  a broader  message,  however:  Given  strong  support  of  training  at 
the  wing  level,  it  is  possible  to  provide  training  at  the  base  that 
directly  supports  job  performance.  The  key  is  the  support  of  the 
wing.  Without  it,  training  resources,  including  students,  will  not  be 
made  available. 

The  Effect  of  the  TOT  Program  on  32632A  Training  at  Cannon  AFB 

Originally,  Task  Oriented  Training  was  seen  as  a means  of 
improving  the  OJT/FTD  interface.  During  1975,  the  movement  of  some 
set  school  training  to  the  F-111  operating  bases  presented  an 
opportunity  to  extend  TOT  to  traditional  3-level  training.  Wlien  we 
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in«'l  with  lh»’  Caiiiioii  KTl)  personnel,  they  were  in  the  process  of 
modifying  the  original  technical  school  course  to  meet  the  unique 
requirements  of  the  Mark  II  avionics  system.  Their  plan  reflected  the 
heavy  emphasis  on  knowledge  rather  than  on  task  proficiency  that  was  a 
feature  of  the  former  set  school  course;  i.e.,  the  "revised"  Specialty 
Training  Standard  had  only  eliminated  the  effects  of  representative 
training. 

The  TOT  personnel,  on  the  other  hand,  berau.se  of  the  general 
enthusiasm  and  the  strong  support  of  the  wing  commander,  were 
optimistic  that  they  would  have  strong  influence  on  the  final  version 
of  the  Phase  11  course.  They  were  concerned  not  only  with  the  course 
content  but  with  the  sequence  of  training  and  favored  their  original 
plan,  shown  in  Fig.  U. 

It  soon  became  evident  that  organizational  and  management 
conflicts  would  hinder  the  implementation  of  the  plan.  From  the  ATC 
side  the  two  major  stumbling  blocks  were  (1)  the  FTD's  insistence  that 
3-level  training  was  ATC's  responsibility  and  that  the  students,  in 
essence,  belonged  to  ATC  until  they  reached  the  proficiency  specified 
for  each  task  and  knowledge  objective  listed  in  the  STS,  and  (2)  if 
the  students  went  to  the  line  before  they  received  the  3-level,  ATC 
would  be  responsible  for  whatever  they  did  or  was  done  to  them  on  the 
line,  and  would  have  to  pay  for  any  TAC  equipment  damaged  by  the 
students . 

On  the  other  side,  the  Avionics  Maintenance  Squadron  supervisors 
wanted  to  control  the  trainee  once  he  had  been  assigned  to  the  shop 
and  did  not  want  to  be  retired  to  send  the  student  back  to  the  FTD 
where  he  would  be  under  Air  Training  Command  control.  Moreover,  if 
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lh<»  stii<l<>nt  vert'  in  the  FTD  hut  still  assif;nc*(l  to  T^C,  TAG  would  bp 
charged  with  the  manpower  slot.  The  upshot  was  that  the  concept  of 
moving  the  trainees  between  the  KTD  and  the  shop  was  abandoned.  As  a 
result,  Cannon's  Phase  II  plan  resembled  the  original  technical  school 
course  more  closely  than  the  TOT  proposal.  The  FTD  plan  called  for  12 
(rather  than  five)  weeks  of  training  to  be  allocated  to  the  topics 
listed  in  the  upper  part  of  Table  21.  No  training  was  to  take  place 
on  aircraft  from  the  operating  inventory  (FTD  bench  trainers  were  to 
be  used),  and  no  training  in  remove/ insta 1 1 LRUs  was  to  be  included.* 

Cannon  AFB  TOT  personnel  worked  with  the  FTD  to  modify  this  plan. 
As  a result  of  their  efforts,  the  course  was  reduced  to  10  weeks  and 
allocated  to  the  topics  shown  on  the  bottom  part  of  Table  21.  A major 
change  was  the  inclusion  of  training  in  remove/ instal 1 LRUs  on 
aircraft  from  the  operating  inventory.  Another  change  was  to  precede 
all  training  in  troubleshooting  with  training  in  operation  and 
operational  check  of  all  systems.  This  made  sense  because  the  most 
challenging  troubleshooting  requires  knowledge  of  the  avionics  package 
as  an  integrated  whole  and  the  ability  to  check  all  elements  of  the 
package.  Unfortunately,  however,  all  of  the  operation  and  operational 
check  training  was  to  be  done  on  a trainer  (not  in  the  cockpit,  where 
much  of  it  is  actually  carried  out).  And,  even  more  unfortunately, 
troubleshooting  was  to  be  taught  before  the  trainee  had  a realistic 
appreciation  of  its  requirements  and  complexity. 

Finally,  as  of  early  1976,  the  POI  still  referenced  the  original 
Specialty  Training  Standard.  This  means  that  many  training  objectives 

*USAF  Training  Plan,  Course  3AQR32622A-0/4ABF32632A- (X) , approved 
June  4,  1975. 
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Table  21 


COURSE  4ABF32632A-4 


Hours 

Per 

For 

For 

Trouble- 

Topic 

Topic 

Checkout 

shooting 

a.  ATC  Proposal 

Orientation  and  safety 

3 

DCC/INS  checkout 

66 

66 

-- 

DCC/INS  troubleshooting 

27 

-- 

27 

IDS  checkout 

48 

48 

-- 

IDS  troubleshooting 

12 

-- 

12 

ARS/DBT  checkout 

54 

54 

-- 

ARS/DBT  troubleshooting 

16 

-- 

18 

TFR  checkout 

42 

42 

-- 

TFR  troubleshooting 

12 

-- 

12 

LARA  checkout 

8 

8 

-- 

LARA  troubleshooting 

4 

-- 

4 

HSD/doppler  checkout 

18 

18 

-- 

HSD/doppler  trouble- 

shooting 

6 

6 

Total 

359 

259 

97 

b.  FTD/TOT  Revision 


Orientation  and  safety 

6 

— 

-- 

Reaove/inatall  LRUs  on 

aircraft 

24 

-- 

-- 

Operation  and  ops  check  on 
trainer 

a 

DCC,  CDS,  BITE 

26 

26 

.. 

INS 

16 

16 

-- 

IDS 

30 

30 

-- 

IDS  & ARS 

48 

48 

— 

LARA 

14 

14 

-- 

TFR 

34 

34 

— 

HSD 

8 

8 

— 

DRS 

9 

9 

— 

DBT 

1 

1 

-- 

Troubleahoot  on  trainer 

DCC 

36 

-- 

36 

INS 

9 

— 

9 

IDS 

8 

-- 

8 

ARS 

12 

— 

12 

TFR 

14 

-- 

14 

LARA 

4 

-- 

4 

Total 

299 

186 

83 

a 

Control  and  Oiaplay  Set. 
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still  referred  to  the  purely  "knowledge"  aspects  of  the  STS, 
particularly  in  the  "checkout"  topics,  although  the  objectives 
themselves  were  stated  in  task-oriented  terms. 

The  1976  plan  for  training  in  the  X2A  career  field  at  Cannon  AFB 
is  illustrated  in  Fig.  6.  Note  that  the  TOT  program  retained  the 
concept  of  teaching  troubleshooting  on  aircraft  from  the  operating 
inventory  after  the  individual  obtained  job  experience.  More 
experienced  personnel  newly  assigned  to  the  base  would  also  attend 
this  course.  We  do  not  know  what  became  of  the  old  7-level  FTU 
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Fig.  6 — Cannon  Air  Force  Base  Bomb/Nav  training  sequence  plan, 

October  1975 


97 


V.  A RKCOMMKNDKI)  FOKMAl.  TRAINING  PROGRAM 
FOR  FI.IGHT-MNK  MAINTKNANCK 


Previous  sections  ol  this  report  have  examine)!  th)‘  joli  content 
o!  flight-line  avionics  maintenance  in  an  atl«-mpt  to  clarify  training 
needs.  With  that  as  a tiackgrouiui , we  examine)!  the  current  training 
program  in  detail,  highlighting  shortcomings  ami  stressing  several 
ilesirable  features,  particularly  tfiose  founil  in  Task  Orienteif 
Training.  In  this  section,  we  describe  a blueprint  for  future 
avionics  training,  drawn  from  the  nature  of  the  job,  past  T26Xa 
training,  and  previous  research  on  technical  training.  Wi*  discuss 
five  principles  for  326  training: 

o Job  performance  should  be  taught. 

o Only  job  performance  should  be  taught. 

o Job  performance  should  be  taught  formally. 

o Job  performance  should  be  taught  at  the  operating 

base  and  when  needed. 

o Initial  formal  training  should  be  alternated  with 
job  experience. 

JOB  PERFORMANCE  SHOULD  BE  TAUGHT 

Our  job  content  analysis  helped  us  understand  the  general  types 
of  skills  and  knowledge  needed  for  job  performance  in  each  of  the  three 
326  specialties.  Almost  all  of  the  skills  ard  knowledge  recjuired 
must  be  learned  because  they  are  not  part  of  the  average  person's 
repertoire.  In  addition,  since  only  a small  part  of  what  needs  to  be 
learned  can  be  derived  from  fundamental  principles,  virtually  all 
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job  performance  in  these  specialties  is  job  specific;  it  cannot  be 
derived  by  application  of  general  principles.  For  example,  the 
specialist  needs  to  learn  where  the  LRUs  associated  with  his  specialty 
are  located  on  the  aircraft  and  how  to  remove  and  install  them 
properly.  Most  remove  and  install  actions  require  only  moderate 
mechanical  skill,  but  some  require  the  use  of  simple  tools  or  safety 
wiring.  The  specialist  also  needs  to  learn  how  to  operate  the 
equipment,  most  of  which  will  be  unfamiliar  to  him,  and  how  to  perform 
operational  checks  on  it.  Many  operational  checks  require  familiarity 
with  the  cockpit  and  with  the  location  and  settings  of  switches  that 
produce  different  modes  of  system  operation.  Operational  checking  may 
require  an  ability  to  interpret  various  displays,  and  to  correctly 
interpret  some  of  the  visual  displays  requires  practice  in  visual 
discrimination . 

Much  of  troubleshooting,  particularly  in  the  Instrument/Autopilot 
and  Comm/ECM  specialties,  involves  only  a single  procedure,  for 
example,  use  of  the  Built-in  Test  Equipment.  Most  of  these  procedures 
are  described  in  the  technical  orders  and  can  be  straightforwardly 
followed  to  locate  the  malfunctioning  unit,  given  knowledge  of  the 
cockpit  and  aircraft  configurations.  Other  troubleshooting  techniques 
require  additional  knowledge  to  be  effective.  The  use  of  remove/ 
install  as  a diagnostic  technique  is  a case  in  point.  Although  the 
technical  order  often  indicates  which  of  several  possibly 
malfunctioning  LRUs  is  the  most  likely  to  have  caused  the  problem, 
other  diagnostic  tools  (including  a knowledge  of  system  operation) 
may  sometimes  resolve  the  ambiguity.  Strategies  for  the  use  of  the 
diagnostic  remove/ instal 1 can  include  which  LRU  to  switch  first  or 
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what  othor  ‘liagnostic  tool  to  use  when  a spare  I.RIJ  is  not  readily 
available. 

The  use  of  Maintenance  Control  Unit  is  another  example.  The 

HCU  printouts  must  be  read  in  combination  with  the  original  "squawk," 
indications  fi^m  the  BITE,  and  computer  readouts.  In  many  instances, 
the  sequence^of'  MCU  prints  must  be  related  to  the  sequence  of  tests 
run  through  the  computer  to  isolate  the  faulty  LRU.  Use  of  such  a 
complex  technique,  composed  as  it  is  of  co.iibi nations  of  logical 
deduction  and  pattern  recognition,  requires  both  the  development  of 
cognitive  skill  and  extensive  exposure  to  patterns  of  occurrences  of 
clues  to  LRU  failure.  It  builds  on  knowledge  of  the  idiosyncrasies  of 
operation  of  the  integrated  system  as  well  as  on  an  ability  to 
formulate  and  apply  strategies  for  use  of  the  diagnostic  techniques  on 
that  system. 

The  performance  of  tasks  that  are  idiosyncratic  to  specific 
systems  should  be  taught  either  on  exact  copies  of  the  system  or  on 
adequate  facsimiles  for  them.  Whether  a facsimile  is  adequate  depends 
on  what  is  being  taught.  For  example,  a mockup  might  be  sufficient 
for  teaching  LRU  remove/install,  the  aircraft  itself  might  be 
best  for  operational  checking,  and  a simulator  for  teaching 
troubleshooting.  For  integrated  avionics,  it  is  particularly 
important  that  all  systems  that  interact  on  the  aircraft  interact  on 
the  simulator,  especially  for  teaching  troubleshooting.  A relatively 
elaborate  facsimile  may  thus  be  needed  for  teaching  the  Bomb/Nav 
specialty.  Facsimiles  for  Instrument/Autopi lot  and  Comm/ECM  can  be 
simpler,  but  should  include  cross-specialty  interactions  if  they 
exist. 
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ONLY  JOB  PKRKORMANCE  SHOULD  BK  TAUGHT 

Traditionally,  Air  Force  entry-level  training  Has  Been  designed 
to  provide  a firm  base  for  an  airman's  progression  through  various 
duties  he  will  perform  in  his  specialty  over  his  career  and  for  the 
various  weapon  systems  assigned  to  his  AFS . Moreover,  within  the 
first  term,  both  the  Career  Development  Course  and  the  Specialty 
Knowledge  Test  stress  knowledge  needed  for  career  advancement.  But 
although  initial  formal  technical  training  is  presented  as  career 
technical  training,  in  fact  only  a small  percent  of  personnel  in  the 
326X2  AFS  elect  to  make  the  Air  Force  a career.  Our  analysis  of  the 
Uniform  Airman  Records  computer  files  indicate  that  on  the  flight  line 
only  13.9  percent  of  the  technician  force  stay  till  their  fifth  year 
of  service.* 

As  demonstrated  in  the  preceding  section,  duties  performed  by 
personnel  with  the  326X2  AFS  are  generally  similar  on  all  weapon 
systems,  although  the  training  required  to  work  on  unique  systems 
satisfactorily  is  often  quite  dissimilar.  In  addressing  a similar 
problem,**  a USAF  Military  Personnel  Center  study  group  concluded  that 


In  order  to  maximize  the  utility  of  the  first-term  work 
force,  qualification  and  utilization  on  only  one  weapons 
system  should  be  enforced....  This  utilization  restriction 


*This  is  the  cumulative  probability  that  an  airman  trained  in 
this  AFS  will  still  be  in  the  Air  Force  four  years  later.  It  is 
calculated  from  quarterly  data  from  September  1972  through  September 
1974.  The  cumulative  probability  should  not  be  confused  with  the 
reenlistment  rate,  which  is  reenlistments  divided  by  those  eligible  to 
reenl ist . 

’’'f*Ac cording  to  the  Palace  Claws  report,  the  Chief  of  Staff 
requested  that  consideration  be  given  to  restricting  the  utilization 
of  personnel  with  F-I5  experience  to  that  weapon  system  alone  for  a 
specified  period  of  time.  See  Classification  of  Airmen  1^  Weajgons 
Support  Systems  (Palace  (^laws),  USAF  Military  Personnel  Center,  1975. 
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will  rciliicf  lilt'  .iinoiiiil  ot  lr<iiniii((  t'xpt'tidt'd  on  first-term 
airmen  and  promote  inireased  expertise  within  the  work 
force.  Kipii  table  assiKiiment  policies  will  dictate 
reipia I 1 f i cat i on  in  additional  weapons  systems  after  the 
inilividiial  enters  the  career  force  upon  the  first 
reeiil  i stmeiit  . * 

AlthoiiKh  weapon  systems  training  is  a necessary  condition,  it  is 
not  in  Itself  sufficient  to  guarantee  that  actual  job  performance  will 
he  taught;  even  though  the  student  might  be  instructed  on  the  weapon 
system  he  will  be  assigned  to  work  on,  training  may  still  be 
irrelevant  to  the  job  he  will  perform.  Nevertheless,  weapon  system 
training  iloes  represent  a major  departure  from  the  traditional 
specialist  career-oriented  entry-level  training. 

Training  only  lor  first-term  jobs  has  major  implications  for 
personnel  management  and  training.  Personnel  managers  would  have  to 
identify  individuals  by  weapon  system  before  training  and 
cross-training  would  be  made  mandatory  between  assignments.  Rotation 
between  the  United  States  and  overseas  could  result  in  some 
"out-of-balance"  AFSCs  requiring  increased  training.  Training  for  the 
first-term  job  requires  not  only  new  utilization  policies,  i.e., 
stability  in  first-term  assignments,  but  also  changes  in  career 
management.  Currently,  for  promotion  an  airman  advances  in  grade  by 
first  advancing  in  skill.  An  important  part  of  skill/grade 
advancement  is  completion  of  the  Career  Development  Course  and  passage 
of  the  Specialty  Knowledge  Test  as  part  of  the  Weighted  Airman 
Promotion  System.  (The  SKT  is  derived  from  the  CDC.)  If  only  job 
performance  is  taught,  it  is  clear  that  the  CDC  should  contain  only 
the  material  directly  pertinent  to  accomplishment  of  the  first-term 

*Pa lace  Claws,  p.  9. 
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job  that  is  not  specifically  related  to  any  weapon  system.*  General 
principles  of  radar,  navigation,  and  weapon  delivery  would  be  incluiled 
as  would  knowledge  of  the  career  field,  maintenance  management , and 
technical  orders.  Post-first-term  training  for  the  small  inunber  of 
individuals  who  remain  in  the  Air  Force  should  contain  not  only  those 
materials  necessary  for  assignment  to  another  weapon  system  but  also 
that  knowledge  required  for  further  career  advancement  within  the  AFS. 

Specific  job-oriented  training  would  not  only  have  implications 
for  the  management  of  training  and  personnel,  but  would  in  most  cases 
bring  out  into  the  open  problems  that  are  currently  hidden  under  the 
concepts  of  representative  and  career  training.  The  above  discussion 
highlights  in  practical  terms  the  consequence  of  largely  abstract 
career-oriented  training  for  one  important  career  field.  The  problem, 
however,  is  more  general  than  the  maintenance  of  advanced  avionics 
systems.  John  Foley  recently  reviewed  the  many  studies  concerning  the 
relative  effectiveness  of  theory  and  job-oriented  training  and 
concluded  that 


The  results  of  these  studies  indicate  that  the 
graduates  of  the  job-oriented  training  programs  are  able  to 
perform  productive  work  immediately  upon  assignment  to  field 
maintenance  units  . . . 

Such  results  would  indicate  that  much  of  the  theory 
content  ...  is  not  relevant  to  the  performance  of  the 
maintenance  tasks  performed  by  personnel  in  their  first 
term.  However,  the  contention  that  a knowledge  of  theory  is 
a necessary  prerequisite  of  the  successful  performance  of 
maintenance  is  deeply  imbedded  in  the  culture  of  the 
electronics  maintenance  community.  But  there  is  no  dc jbt 

*An  alternative  would  be  to  have  an  evaluation  team  administer 
job  performance  tests  to  all  persons  in  the  AFS  being  considered  for 
promotion.  This  would  probably  be  prohibitively  expensive. 
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that  this  prere<^isite  adds  greatly  to  the  personnel  ^os^ 
of  the  Air  Force*. 


JOB  PERFORMANCE  SHOULD  BE  TAUGHT  FORMALLY 


Formal  training  can  be  more  effective  than  training  on  the  job 
because  it  provides  a controlled  environment.  This  greatly  increases 
the  probability  that  training  will  be  provided  on  all  of  the  important 
tasks  in  the  job,  that  each  trainee  will  be  taught  these  tasks,  and 
that  he  will  learn  to  do  the  tasks  correctly . Formal  training  can  be 
sequenced  to  develop  skills  and  knowledge  in  a systematic  way,  and 
students  can  be  assured  of  sources  of  information  and  assistance  when 


they  have  job-related  problems.  In  addition,  students  who  cannot  or 
will  not  work  as  the  job  requires  can  be  weeded  out  before  they  are 
assigned  to  a work  center. 

Assuming  that  the  trainee  is  adequately  motivated  to  learn, 
knowledge  of  such  subjects  as  the  vocabulary  of  the  job,  the  use  of 
technical  orders,  and  general  strategies  for  fault  isolation  can  be 
taught  most  effectively  in  a formal  setting.  However,  the  need  for 


*John  P.  Foley,  Evaluating  Maintenance  Performance:  An  Analysis, 
Air  Force  Hunan  Resources  Laboratory,  Air  Force  Systems  Command, 
Wright-Patterson  Air  Force  Base,  Ohio,  AD/A-004  761,  October  1974, 
p.  24.  Also  see  W L.  Williams,  Jr.,  and  P.  G.  Whitmore,  Jr.,  The 
Development  and  Use  of  a Performance  Test  as  a Basis  for  Comparing 
Technicians  With  and  Without  Field  Experience.  The  NIKE  AJAX  AFC 
Maintenance  Technician,  Human  Resources  Research  Office,  The  George 
Washington  University,  Washington,  D.C.,  Technical  Report  52,  AD-212 
663,  Septembei  1959;  George  H.  Brown  et  al..  Development  and 
Evaluation  of  an  Improved  Field  Radio  Repair  Course,  Human  Resources 
Research  Office,  The  George  Washington  University,  Washington,  D.C., 
Technical  Report  53,  Project  Repair,  1959;  E.  L.  Shriver,  Determining 
Training  for  Electronics  System  Maintenance:  Development  and  Test  of 
a New  Method  of  Skill  and  Knowledge  Analysis,  Human  Resources  Research 
Office,  The  George  Washington  University,  Technical  Report  63, 

Project  FORECAST,  AO  239  416,  Washington,  D.C.,  I960. 
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I'.ji  h of)j»'Ctiv<’  falling  in  lti<-  "knowledge"  ealegory  should  he 

eslahlislu’d  hy  a rig<irons  analysis  of  the  reijn  i remenls  for  joli 
|)erf  ormam  e . Miit  h of  the  knowledge  needed  is  either  in  the  technical 
orders  or  should  he  in  tlu'in. 

Teaching  job  performance  in  formal  training  can  produce-  an  airman 
•-'ho  is  of  imme<1iate  use  to  the  operating  unit.  The  maintenance 
supervisor  can  count  on  productive  work  from  each  man  in  his  shop 
rather  ttian  having  to  consider  a large  fraction  of  his  personnel  as 
jiossible  detriments  to  performance  of  maintenance.  This  is 
particularly  important  at  CONUS  bases,  which  have  proportionately 
large  numbers  of  T-levels.  Personnel  thoroughly  trained  in  correct 
procedures  will  be  less  likely  to  damage  equipment  during 
remove/ i nsta 1 1 actions,  to  pull  the  wrong  LRUs,  or  to  perform  mechanical 
tasks  incorrectly.  This  offers  the  possibility  of  alleviating  the 
requirements  for  spares,  reducing  the  need  for  cannibalization  of 
equipment,  and  increasing  the  Operationally  Ready  rate  of  the  unit. 

Teaching  job  performance  in  formal  training  may  not  be  as 
expensive  as  it  first  may  appear.  Other  Rand  work  suggests  that  the 
hidden  cost  of  OJT  is,  in  fact,  considerable.  In  a pilot  study,  Gay 
showed  that  the  OJT  cost  for  airmen  in  the  431X1  AFSC  (Aircraft 
Maintenance  Specialist)  was  approximately  twice  the  cost  of  their 
technical  school  training  and  about  half  the  total  cost  of  the  Air 
Force's  first-term  investment  in  the  airman.* 

In  addition,  graduates  of  formal  training  who  are  proficient  in 
their  jobs  are  likely  to  have  higher  morale,  and  a feeling  of 

*Robert  M.  Gay,  Estimating  the  Cost  of  Qn-the-Job  Training  in 

Military  Occupat ijons ^ A Methodology  and  Pilot  Study,  The  Rand 

Corporation,  R-1351-ARPA,  April  1974. 
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ach  1 «'v«'ni<-iit  is  oiu-  of  I ho  m.ijor  ooiil  r i liiil  ors  to  joh  satisfaction  * 

Job  satisfaction  may  also  strongly  affect  the  (jiiality  of  the  work 
proiliiced . Herzberg  et  al.  found: 

Accor<ling  to  the  people  we  interviewed,  attitudes  toward  the 
job  exerted  an  extremely  important  influence  on  the  way  in 
which  the  job  was  done.  In  over  60  percent  of  | the 
interviews!  an  improved  performance  related  to  improved  job 
attitudes  and  a decrease  in  performance  related  to  a change 
of  attitude  in  a negative  direction.""" 

Thus,  there  seems  to  be  more  than  common  sense  evidence  to  support  the 
contention  that  a proficient  airman  not  only  saves  resources  recpiired 
for  OJT  but  starts  work  with  a better  and  more  productive  attitude 
than  the  airman  who  starts  his  work  experience  unable  to  perform  the 
simplest  task. 

Job  performance  can  be  taught  in  a formal  setting.  Ihidergraduate 
pilot  training  leads  the  trainee  through  a course  of  study  that 
intersperses  classroom  instruction  with  training  in  simulators  and  on 
operational  aircraft.  Similarly,  some  commercial  airlines  train  their 
pilots  to  fly  new  aircraft  in  highly  structured  courses  using 
combinations  of  classroom  instruction,  independent  study,  and 
simulators.  Finally,  civilian  corporations,  like  IBM,  train  employees 
to  maintain  their  equipment  through  structured,  in-house  programs. 

Numerous  experiments  have  been  carried  out  to  demonstrate  that 
the  maintenance  of  military  equipment  can  be  taught  in  a formal 
setting.  The  Peer  Instruction  experiment  conducted  by  the  Human 

♦Frederic  Herzberg,  Bernard  Mausner,  and  Barbara  B. 

Snyderman,  The  Motivation  to  Work,  John  Wiley  & Sons,  Inc., 

New  York,  1959. 

♦♦The  Motivation  to  Work,  p.  87. 
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1 Resources  Research  Organizalion  for  the  Army  in  1968  is  probably  the 

most  convincing.  In  this  experiment,  trainees  in  the  Field  Wireman 
Course  (MOS  16K20)  were  trained  by  their  peers  in  a course  that 
stressed  performance  orientation,  learning  in  a job  context,  and  an 
"absolute  criterion"  (i.e.,  each  trainee  must  meet  performance 
standards  of  speed  and  accuracy).  Graduates  of  the  course  were 
"markedly  more  competent  in  terms  of  job  proficiency  than  were  the 
graduates  of  the  conventional  system."* 

The  1968  Learner  Centered  Instruction  (LCI)  Experiment  is 

I 

particularly  relevant  because  it  concerned  the  maintenance  of  the 

avionics  system  on  the  F-lllA.  (The  A model  is  the  only  F-111  with  an 

I analog  computer  complex.)  In  this  experiment,  airmen  entering  the 

r Weapon  Control  Systems  Mechanic/Technician  specialty  (AFSC  322X1R) 

were  trained  to  perform  tasks  that  an  analysis  had  indicated  would  be 

essential  to  the  F-lllA  job.  Both  at  the  end  of  the  course  and  five 

months  after  graduation,  the  experimental  students  were  judged  to  be 

better  in  the  speed  and  accuracy  with  which  they  performed  tasks  under 

test  conditions  than  their  peers  who  had  been  trained  in  the 

conventional  course.  These  tasks  included  checkout  and  detection  of 

malfunctions  on  a training  simulator  and  a test  set,  as  well  as 

paper-and-pencil  troubleshooting.  The  evaluation  report  stated  that 

This  finding  in  regard  to  end-of-course  results  is  not 
particularly  surprising,  considering  the  differences  in  the 
content  of  the  two  courses.  The  LCI  course  dealt  primarily 
with  teaching  the  required  job  behaviors,  while  the 
conventional  course  dealt  primarily  with  teaching  electronic 


*Kenneth  Weingarten,  Jacklyn  E.  Hungarland,  and  Hark  F.  Brennan, 
Development  and  Implementation  of  a Quality-Assured  Peer-Instructional 
Hodel:  Final  Report  on  Work  Unit  APSTRAT,  Human  Resources  Research 
Organization,  Division  No.  3,  Presidio  of  Monterey,  California,  April 
1972,  p.  v. 
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principles  of  equipment  operation.  What  is  of  interest  is 
the  field  follow-up  results,  which  show  that  the  ...  LCI 
subjects  maintained  their  superiority  over  the  Control 
group .* 

Unfortunately,  the  LCI  experimenters  themselves  rated 
the  performance  of  both  the  experimental  and  control 
students,  making  it  impossible  to  accept  the  experimental 
evidence  without  reservation.  However,  the  results  were 
reinforced  by  the  ratings  of  job  performance  in  the  field. 

Each  time  a subject  in  the  experiment  (LCI  or  control)  worked  on  the 
flight  line,  his  supervisor  or  trainer  rated  him  as  he  performed  the 
job.  At  the  end  of  the  experiment,  the  average  of  the  ratings  for 
each  subject  showed  no  significant  difference  between  the  LCI  and 
control  students.  This  was  important  because  LCI  was  considerably 
cheaper  (by  over  AO  percent)  than  the  conventional  course,  largely 
because  it  deleted  basic  electronics. 

Despite  the  success  of  the  LCI  approach  in  preparing  airmen 
to  do  the  job,  it  was  not  implemented.  Personnel  from  the  AF  Human 
Resources  Research  Laboratory,  Technical  Training  Division,  attribute 
this  to  two  causes.  Perhaps  the  more  important  is  that  the  content  of 
the  Job  changed  radically  as  the  F-lllA  was  introduced  into 
operational  units,  so  the  training  provided  by  the  LCI  materials 
becaaie  outdated.  Second,  graduates  of  the  LCI  course  lagged  in 
completing  their  Career  Development  Course  and  Specialty  Knowledge 

‘Miiilliam  J.  Pieper,  Robert  W.  Swezey,  and  Horace  H.  Valverde, 
Learner-Centered  Instruction  (LCI);  Volume  VII.  Evaluation  of  the 
LCI  Approach,  Training  Research  Division,  Air  Force  Human  Resources 
Laboratory,  Air  Force  Systems  Command,  Wr ight-Patterson  Air  Force 
Base,  Ohio,  AFHRL-TR-70-l , February  1970,  p.  39. 
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Tost  by  5 to  6 months  due  to  their  lack  o(  training  in  basic 
e lect  ron i cs . 

In  another  experiment  in  the  late  1960s,  the  DoD  and  IJSAT 
Communications-Electronics  Training  Service  Test  Program  at  Kr-esler 
Technical  Training  Center  evaluated  alternative  training  concepts  tor 
entry-level  training  in  the  Electronic  Navigation  Etjuipment  specialty 
and  the  Aircraft  Control  and  Warning  Radar  specialty.  While  these 
are  avionics  specialties,  men  training  in  these  occupations,  unlike 
those  in  326Af'S,  were  responsible  for  both  flight- line  and  shop  repair 
of  equipment,  including  troubleshooting  internal  circuitry.  Moreover, 
they  worked  on  analog  systems,  which  are  much  less  integrated  than  the 
advanced  avionics  in  the  F-111,  F-15,  and  F-16  aircraft.  Of 
particular  interest  were  men  trained  under  the  "cue- response"  concept, 
which  emphasized  equipment-oriented  training.  Electronics  principles 
were  introduced  only  as  needed  to  perform  maintenance  procedures. 

Even  so,  the  end-of-course  comparison  of  graduates  of  the  job-oriented 
and  conventional  courses  favored  the  former  on  certain  job-oriented 
maintenance  procedures.  After  10  weeks  on  the  job,  the  two  groups 
showed  only  slight  differences  in  job  proficiency.*  Yet  the 
experimental  group  had  had  only  60  percent  as  much  training  as  the 
graduates  of  the  conventional  course. 

Although  we  have  strong  misgivings  about  the  way  the  evaluation 
was  carried  out,  we  do  note  that  according  to  the  final  report**  the 

*DoD  and  USAF'  Coniunications-Electronics  Training  Service  Test 
Program,  Synoptic  Report  tor  Volumes  1 thro^^h_7.  Air  Training 
Command,  EPR  66-20,  Nay  27,  1968,  p.  i. 

**I^D  and  USAF  Commun i ca tions-E I e'' ironies  Training  Service 
Test  Program,  Synoptic  Report,  Air  Training  Command, 

EPR  66-20,  May  28,  1970,  pp . 9,10. 
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i ut'-rospoiise  group  had  "problems  when  confronted  with  unfamiliar 
e(piipmenl  or  unorthodox  troubles  reijuiring  detailed  circuit  analysis 
...  Iwhenl  isolating  malfunctions  below  the  hlack  box  level."  Such 
would  not  hamper  326  flight-line  technicians,  since  their 
responsibilities  extend  only  to  the  sealed  LRU  (black  box).  Although 
"using  schematic  diagrams  and  ...  knowle<lge  of  electronics 
fundamentals  and  basic  electronics  circuits  ...  are  key  elements  in 
the  theoretical  troubleshooting  process"*  for  the  Keesler  AFB  test 
specialties,  the  job  content  survey  demonstrated  that  such  knowledge 
is  not  used  in  the  326X2  flight-line  occupations. 

The  comments  of  the  research  psychologist  assigned  to  the  Keesler 
project  are  also  illuminating: 


...  at  the  end  of  the  first  year,  the  supervisory  personnel 
had  begun  to  take  a firm  stand  favoring  the  men  with  the 
more  extensive  vocabulary  and  fundamental  knowledges, 
probably  because  they  were  needed  for  the  men  to  complete 
the  requirements  for  on-the-job  training  and  testing  for 
their  "5"  skill  levjl  AFSC . Apparently  the  knowledge  gap 
needing  to  be  filled  in  by  the  experimental  group  added  a 
marked  burden  for  the  field  personnel  and  their  comments 
reflected  this. 

If  the  same  on-the-job  training  and  testing  requirements 
(SKT,  CDC , etc.)  to  obtain  the  "5"  skill  level  are 
maintained,  there  is  no  doubt  but  that  the  field  training 
units  will  have  to  add  to  their  training  programs  which  they 
resent  and  would  prefer  not  to  do. 

If  (this]  concept  of  experimental  training  should  be  adopted, 
...  the  first  enlistment  on-the-job  training  requirements 
...  should  be  reconsidered.* 


*D0D  and  USAF  Communications -Elec ironies  Training  Service  Test 
Program,  Synoptic  Report  for  Volumes  1 through  7,  Air  Training 
Command,  EPR  66-20,  May  27,  1968.  About  half  of  the  graduates  of  the 
experimental  course  rated  it  as  inadequate  preparation  for  the  CDC/SKT 
portions  of  upgrading  and  promotion,  compared  to  about  7 percent  of 
the  graduates  of  the  control  courses. 
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The  two  experiments  described  above  illustrate  the  damaKinK 
consequences  of  radically  revising  a training  course  without  making 
the  necessary  concomitant  revisions  in  personnel  management,  that  is, 
without  paying  serious  attention  to  the  organizational  context  of 
training.  The  Air  Force  structure  reflects  a policy  that  allocates 
career  training  (specifically,  training  in  "subject  knowledge"  and 
"job  knowledge")  to  formal  courses  and  training  in  job  performance  to 
OJT.  This  policy  is  so  deeply  ingrained  in  all  aspects  of  training 
that  it  is  a major  barrier  to  teaching  job  performance  in  a formal 
setting.  Thus,  the  question  is  not  whether  job  performance  can  be 
taught  in  a formal  setting  but  whether  the  current  military 
organizational  structure  can  be  changed  to  facilitate  formal  teaching 
of  job  performance.  Task  Oriented  Training,  discussed  earlier, 
provides  evidence  of  success  in  teaching  job  performance  in  a formal 
setting  and  in  an  operational  environment  if  the  organizational  issue 
is  dealt  with  directly. 

JOB  PERFORMANCE  SHOULD  BE  TAUGHT  FORMALLY  AT  THE  OPERATING  BASE 
AND  WHEN  NEEDED 

Teaching  job  performance  at  the  operating  base  improves  access  to 
the  job  itself,  which,  if  taken  full  advantage  of,  would  significantly 
improve  the  relevance  of  training.  For  example,  instructors  and 
students  could  work  on  equipment  from  the  operating  inventory, 
learning  equipment  locations,  removal/instal lation  of  I.RUs,  equipment 
operation,  operational  checking,  and  even  some  troubleshooting  of 
actual  malfunctions. 

Instructors  would  come  from  the  active  work  force  and  would  be 
thoroughly  familiar  with  the  job.  They  would  visit  the  worK  centers 


and  work  in  them  to  learn  the  latest  techniques  in  job  performance,  to 
find  out  what  special  training  shop  supervisors  need  for  their 
personnel,  or  to  conduct  in-shop  training  sessions.  The  training 
center  could  become  a library  of  information  on  job  performance  and 
could  house  system-specific  mockups,  cutaway  units,  simulators,  and 
bench  trainers.  Maintenance  of  training  equipment  would  be  readily 
available  for  all  job  incumbents,  not  only  trainees.  In  short,  formal 
training  in  job  performance  at  the  operating  base  could  benefit  both 
training  and  the  job.  The  Navy  practice  of  collocating  their 
equivalent  of  3-level  set  school  with  an  aircrew  training  squadron  (the 
Replacement  Air  Group)  suggests  that  what  we  are  proposing  has  proven 
useful  in  an  operational  setting. 

A drawback  to  this  proposal  is  that  the  base  to  which  the  airman 
will  be  assigned  must  be  known  before  training  begins.  Shortening 
courses  by  deleting  nonjob-related  topics  will  alleviate  this  problem 
somewhat;  however,  we  cannot  say  at  this  point  whether  or  how  the 
problem  can  be  completely  resolved.  Recent  changes  in  training  for 
Lne  Bomb/Nav  specialty,  discussed  previously,  suggest  that  Air  Force 
personnel  managers  believe  they  can  circumvent  the  difficulty. 

Another  possible  disadvantage  is  that  moving  training  to  the 
operating  bases  will  fragment  the  training  to  the  extent  that  it 
becomes  too  expensive.  This  does  not  seem  likely,  since  the  FTDs  are 
already  providing  training  to  the  bulk  of  the  new  3-levels  when  they 
arrive  on  base.  Additionally,  any  increased  cost  of  formal  job 
performance  training  may  be  more  than  offset  by  decreased  length  of 
resident  training  and  the  savings  in  OJT  alluded  to  earlier. 


Wh»‘r«'v«T  |<)|is  ililljT  so  iniicli  1 rum  ono  to  aiiolluT  or  from  one  liasj' 
lo  .tnotficr  Ifiat  rotraiiuriK  is  lu'tolpd , surli  traitnrig  stioiild  f«- 
maiidalory  Icj  assure  tfi*-  proficiency  of  the  work  force.  A well 
structured,  formal  prof^ram  that  relates  to  and  builds  on  a man's  past 
experience  would  ensure  that  before  he  is  assigned  to  new  e<4uipment  In- 
is given  the  opportunity  to  become  thoroughly  familiar  with  it. 
Specializeil  advanced  training  is  especially  important  for  senior  liiu* 
supervisors  who  are  responsible  for  the  technical  (piality  of  the  work 
in  their  shop  and  sln>ul>1  be  able  to  supply  direction  when  less 
(-xperienced  personnel  an-  unable  to  solve  a technical  problem. 

Within  the  Bomb/Nav  sjx-cialty,  most  of  the  tasks  (particularly 
the  more  difficult  t roubli-shooting  ones)  are  unir)ue  to  particular 
models  of  aircratt  because  of  the  integrated  nature  of  the  avionics. 
Within  the  Instrument/Autopilot  and  Comm/ECM  specialties,  less 
training  will  be  needed,  particularly  for  reassignments  among  F-111 
models.  Hetraining  needs  will  obviously  be  greater  for  personnel  who 
are  assigned  to  a 326X2X  specialtv  from  another  career  field. 

Both  the  desirability  and  the  feasibility  of  such  an  approach  are 
supported  hy  the  Navy  policy  of  giving  special  training  in  the 
maintenance  of  specific  equipment,  awarding  a unique  Naval  Enlisting 
Classification  code,  and  assigning  on  the  basis  of  the  special 
training  and  code.  If  a man  is  assigned  to  different  equipment,  he 
must  be  given  training  on  that  equipment. 

The  cost  of  retraining  upon  reassignment  is  likely  to  be  small 
because  the  training  unit  would  already  support  initial  training.  The 
cost  will  be  smaller  still  if  first-term  tours  of  duty  are 
"stabilized,"  that  is,  if  the  airman  is  assigned  to  only  one  operating 


base  during  his  first  enlistment. 
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INITIAL  FORMAL  TRAINING  SHOULD  BK  ALTERNATF.I)  WITH  .JOB  KXl'KRIFNCF 

Boiauso  of  llie  oomplcxily  of  advanced  avioniis  ciiii  i pmont  , 
alternating  periods  of  formal  training  with  actual  job  experience 
would  have  several  advantages.  First,  the  length  of  the  first  period 
of  training  would  be  shortened  so  that  the  trainee  would  he  able  to 
apply  what  he  has  learned  while  it  is  still  fresh  in  his  mind.  The 
first  training  period  would  concentrate  on  the  tasks  that  are 
fundamental  to  the  spec i a 1 ty-- remova 1 / insta 1 J a t i on  of  LRUs, 
operational  checking,  and  simple  t rouh 1 eshoot i ng . Practice  of  these 
skills  on  the  job  would  give  the  airman  a chance  to  master  them  to  the 
extent  that  they  become  almost  automatic.  In  addition,  during  this 
period  the  airman  would  no  longer  be  under  the  instructor's  wing  and 
would  have  to  take  responsibility  for  doing  the  job  correctly,  thus 
motivating  the  good  worker  to  develop  skills  of  finding  information 
and  solving  problems.  Finally,  in  the  course  of  his  work  the  airman 
would  become  familiar  with  the  concrete  context  to  which  the  abstract 
principles  of  job  performance  apply.  Thus  he  would  be  better  prepared 
to  appreciate  the  need  for  mastery  of  the  aspects  of  the  job  that  are 
more  intellectually  demanding,  particularly  strategies  for 
troubleshooting  and  the  knowledge  of  system  operation  on  which  they 
are  based.  In  fact,  the  trainee  may  well  be  primed  with  questions 
about  job  performance  when  he  reenters  the  classroom. 

A further  benefit  is  that  the  returning  trainee  will  bring  to  the 
classroom  flight-line  experience  that  could  improve  the  content  of  the 
training.  Alternating  initial  formal  training  with  job  experience 
would  support  the  job  at  the  same  time  that  it  would  reinforce  the 


individual  trainee's  development  of  job  proficiency. 


We  are  not  prepared  at  this  point  to  say  where  job  experience 
sliould  be  inserted  in  the  initial  courses  in  each  of  the  specialties 
how  long  it  should  be,  or  how  many  parts  the  entire  sequence  should 
contain.  Probably  an  initial  period  during  which  the  simpler  tasks 
are  taught  should  be  followed  by  at  least  a month  of  job  performance 
The  initial  training  sequence  might  then  be  completed  with  training 
the  more  complex  tasks.  Such  a scheme  looks  quite  feasible  for  the 
Bomb/Nav  specialty  and  might  also  be  desirable  for  the  other  two. 


VI.  TRAINING  MANAGEMKNT 


During  periods  of  rapid  change  it  is  all  loo  easy  for  close  ties 
between  training  and  the  job  to  be  broken.  Although  ATC  has  devised 
management  procedures  to  make  sure  that  training  is  responsive  to  the 
needs  of  the  field,  as  illustrated  in  the  preceding  section,  they  are 
often  ineffective.  In  this  section,  we  will  consider  problems  in  the 
management  of  training. 

Working-level  training  managers  play  critical  roles  in  three 
important  areas:  first,  in  the  determination  of  what  the  job  requires 
in  terms  of  specific  knowledge  and  skills;  second,  in  translating  this 
information  into  a course  tnal  teaches  the  required  knowledge  and 
skills  both  effectively  and  efficiently;  and  finally,  in  making  sure 
that  feedback  from  the  field  is  evaluated  to  guarantee  the  relevance 
of  training.  These  tasks  are  not  only  the  responsibility  of  the 
providers  of  training;  it  is  equally  necessary  for  the  users  of 
trained  personnel  to  make  sure  that  each  task  is  accomplished  in 
accordance  with  their  needs.  Unless  both  sides  are  actively  involved 
in  the  process,  defects  will  arise.* 


*The  Air  Training  Command  has  been  aware  of  the  need  for  improved 
management  of  training  for  a number  of  years.  In  the  early  1970s, 
they  began  applying  Instructional  Systems  Development,  a set  of 
systematic  procedures  for  course  development  and  evaluation,  on  a wide 
scale  within  technical  training.  It  has  five  steps:  analysis  of  the 
tasks  comprising  the  job;  derivation  of  training  requirements  from 
this  analysis;  specification  of  training  objectives;  planning, 
developing,  and  internally  validating  instruction;  and  evaluation  and 
feedback  from  the  field.  The  two  crucial  steps  in  assuring  that  the 
resulting  course  is  relevant  to  the  job  are  the  task  analysis  and 
evaluation.  Because  Instructional  Systems  Development  has  been 
primarily  an  ATC  concern,  the  tendency  has  been  to  concentrate  on  the 
planning,  development,  and  internal  validation  of  instruction  within 
the  departments  and  branches  of  the  technical  schools. 
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POLICY  FOR  THK  MANAC.KMKNT  OF  FORMAL  TRAINING 

The  sl.irting  point  for  training  managomont  is  the  jot)  <lpsc  ri[)t  ion 
in  the  Airman  Classification  Manual,  which  sots  fortfi  in  very  gpru-ral 
terms  the  knowledge  required  for  tfie  job  and  duties  it  entails  (see 
Fig.  7).  Next,  the  Specialty  Training  Standard  expands  the  jof) 
ilescription  into  training  reipi  i rements  tor  the  specialty.  These 
requirements  are  stated  in  terms  of  prescribed  levels  of  proficiency 
in  subject  knowledge,  task  knowledge,  and  task  performance,  wtiich 
become  the  training  standards  for  botfi  formal  courses  and  OJT.  For 
formal  training,  the  Specialty  Training  Standard,  in  turn,  is  expandeil 
into  a Plan  of  Instruction,  which  describes  in  detail  the  course  that 
will  produce  the  required  levels  of  proficiency.  The  list  of  tasks  in 
the  Standard  also  provides  the  structure  for  evaluation  and  ilefines 
the  knowledge  required  for  the  Career  Development  Course  and  the 
Specialty  Knowledge  Test.  It  therefore  plays  a key  role  in  the 
promotion  process,  since  the  Test  in  the  Weighted  Airman  Promotion 
System  is  generally  derived  from  the  Course.*  The  CDC  is  a 
correspondence  course  in  fundamentals  and  task  knowledge  common  to  any 
job  in  the  specialty.  It  builds  on  the  material  presented  in  the 
initial  course.  Two  activities  link  training  directly  to  the  job:  the 
task  analysis,  which  establishes  the  tasks  performed  on  the  job,  and 
evaluation,  which  rates  the  effectiveness  with  which  airmen  have  been 
trained  for  the  job. 

*ATC  Regulation  52-2  states,  "When  a CDC  is  available,  it  is  used 
as  the  sole  source  for  SKT  questions"  (p.  2). 


Fig.  7 — Management  of  formal  training:  stated  policy 
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MANAGKMKNT  OF  FORMAI.  TRAINING  IN  ORKRATION 

On  the  (ace  of  It,  the  process  we  have  described  is 
straightforward  and  contains  the  links  necessary  to  training 
relevance.  In  actuality,  however,  no  step  in  the  process  follows 
directly  from  another;  each  is,  in  effect,  a translation  or 
amplification  of  information  from  one  frame  of  reference  to  another 
and  hence  requires  much  subjective  judgment.  Generally,  this  judgment 
is  supplied  by  the  subject  matter  specialists  in  ATC,  and  each  step  in 
the  process  passes  through  this  "common  filter,"  as  illustrated  in 
Fig.  8.  To  be  sure,  there  are  many  points  at  which  other  Air  Force 
agencies,  including  other  echelons  within  ATC  itself,  participate  in 
the  management  of  training  both  formally  and  informally,  but  this 
participation  is  often  ineffective,  as  became  clear  when  we  traced  in 
detail  the  management  of  326  formal  training. 

Airmen  Classification  Manual 

To  understand  the  process  of  training  management  better,  we 
interviewed  Air  Force  officers  assigned  to  the  classification  branch 
of  the  Military  Personnel  Center.  We  were  told  that  in  preparing  the 
job  description  for  the  Airmen  Classification  Manual  (AFM  39-1)  they 
rely  on  inputs  from  many  sources,  but  for  the  knowledge  required  they 
give  heavy  weight  to  ATC's  inputs  and  refer  to  the  course  of 
instruction.  As  a result,  the  stated  knowledge  requirements  reflect 
the  current  course  of  instruction  rather  than  the  requirements  for 
satisfactory  job  performance. 

Task  Analysis 


Task  analysis  is  one  of  the  major  links  between  the  Specialty 
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I raining  Slarnlard,  lti»‘  (Man  ol  1 nsl  rncl  ion , and  llic  job."  ll  is 
generally  airepti-d  that  a well  executed  analysis  that  captures  the 
detailed  skills  arnl  knowledge  reipiired  lor  each  task  is  a desirable 
first  step  in  developing  a Plan  ol  Instruction.  As  currently  carried 
out,  however,  task  analysis  has  two  major  defects.  The  first  and  most 
obvious  is  that  freijuently  an  up-to-date  task  analysis  is  not 
available,  as  was  the  case  lor  the  ',i26X2X  AKSCs.  As  ol  early  1976, 
there  still  was  no  task  analysis  tor  the  T26X2B  and  C AKSCs,  and  the 
’’task  analysis"  for  326X2A  is  inadequate,  as  we  shall  show  shortly. 

The  first  Occupational  Surveys  for  the  326X2X  (light- line  shops  were 
not  available  in  the  summer  of  1976.  One  reason  i:  that  the  task 
analysis  must  deal  with  the  entire  specialty,  not  just  with  a job  in 
the  specialty,  which  means  that  it  usually  took  over  a year  to 
Complete  and  report  on  a single  task  analysis.  Thus,  the  requirement 
that  training  support  the  entire  specialty  is  partly  responsible  for 
the  lack  ol  task  analyses  responsive  to  changing  needs  in  the  field. 

The  second  problem  is  that  the  task  analysis  as  currently 
conducted  is  not  an  analysis  of  what  a person  needs  to  know  to  perform 
a Job,  the  most  significant  aspect  for  training.  Rather,  it  is  an 
inventory  of  the  tasks  performed  in  the  specialty,  as  defined  in  an 
Occupational  Survey.  The  Occupational  Surveys,  conducted  by  the 
Occupational  Measurement  Branch  of  ATC,  are  the  preferred  source  of 
the  task  analysis  for  Instructional  Systems  Development.**  While 
useful  as  an  indication  of  the  tasks  that  constitute  the  specialty, 

*See  Air  Force  Spei^ialt^  Trainings  Stai^dard , ATC  Supplement  1, 

AFT  8-13,  February  1,  1975,  p.  U. 

**See  The  Handbook  for  De8i_gners  of  Instructional  S^stemsj  Vol. 
II,  Task  Analysis,  AFP  50-58,  July  1973." 
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they  provnlf  litll«‘  Kuidatice  on  what  a p»‘rson  has  to  know  to 
perlorm  a j^iven  task.  In  gc'neral,  thr  intormation  tlwy  gathor 
concerns  only  the  percent  of  people  (at  various  skill  levels  and  with 
various  backgrounds)  that  perform  a given  task  and  the  percent  of  time 
spent  on  that  task  in  their  current  Job.  For  illustration,  a page 
from  the  inventory  for  the  326X1A  field  is  shown  in  Fig.  9.  The 
translation  of  such  an  inventory  into  a training  program  is  not 
obvious  or,  in  most  cases,  straightforward.  For  example,  does  the 
task  "perform  fault  isolation  procedures  on  ARS  synchronizers"  require 
a knowledge  of  circuit  analysis,  Zener  diodes,  or  video  amplifiers? 
Does  one  need  to  know  how  test  equipment  works,  or  only  how  to  use  the 
test  equipment?  To  design  a training  program  one  must  know  what 
knowledge  and  skills  are  needed  to  perform  maintenance  and  make  the 
judgments  required  on  the  job. 

In  a similar  vein,  ATC's  specialist  task  analysis  for  the  326X2A 
career  field  was  not  specific  enough  for  determining  training 
requirements.  As  part  of  the  effort  to  improve  training  in  this  AFSC, 
ATC  asked  the  F-111  squadrons  to  respond  to  a survey  quest ionna i re 
with  the  objective  of  analyzing  the  specialist  tasks.  The  following 
discussion  of  this  effort  demonstrates  that  further  work  is  needed  to 
identify  the  training  content  for  this  career  field. 

The  survey  at  Mountain  Home  Air  Force  Base  was  conducted  by 
members  of  the  Field  Training  Detachment  and  the  Avionics  Maintenance 
Squadron.  In  all,  35  members  of  the  AMS  at  Mountain  Home  responded. 
The  survey  collected  data  in  two  areas:  task  support,  which  would 


help  identify  the  importance  of  the  task  for  training,  and  training 
support.  Table  22  shows  the  elements  in  each  category. 
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1.  PERTCRN’iriG  PAULT  ISOLATION  PROCEDURES  ON  LINE  REPLACEAE<LE 

UNITS  (LRU) 

1.  Perforr.  fault  isolation  procedures  on  airspeed  electronic 

anp 1 i f iers  61 

2.  Perforn  fault  isolation  procedures  on  jititude  eiectroni; 

control  amplifiers  • 62 

3.  Pertorr  fault  isolation  procedures  on  amplifier  power 

supp I ies  (T^R)  63 

4.  Perform  fault  isolation  procedures  on  analog  display 

indicators  64 

5.  Perform  fault  isolation  procedures  on  antenna  receivers 

65 

6.  Perform  fault  isolation  oroced|ures  on  antenna  selectors 

66 

7.  Perform  fault  isolation  procedures  on  APS  antenna 

assemb lies  67 

8.  Perform  fault  isolation  procedures  on  ARS  antenna  controls 

68 

9.  Perform  fault  isolation  procedures  on  ARS  antenna  pedestals 

69 

10.  Perform  fault  isolation  procedures  on  ARS  control  antenna 

indicators  70 

II.  Perform  fault  isolation  procedures  on  ARS  indicator 

recorders  71 

12.  Perform  fault  isolation  procedures  on  ARS  synchron i zers 

72 

13.  Perform  fault  isolation  procedures  on  astro  compass 

trackers  08:73 

■ - ■ 

■ — 

14.  Perform  fault  isolation  procedures  on  astro  electronic 

unit  analog  to  digital  converter's  5 

15.  Perform  fault  isolation  procedures  on  astro  electronic 

unit  digital  interface  assemblies  6 

16.  Perform  fault  isolation  procedures  on  astro  electronic 

unit  power  supplies  7 

— 

17.  Perform  fault  isolation  procedures  on  attitude  director 

indicators  8 

18.  Perform  fault  isolation  procedures  on  autopilot  damper 

panels  9 

19.  Perform  fault  isolation  procedures  on  ballistics  computers 

—LQ. 

20.  Perform  fault  isolation  procedures  or,  battery  units 

1 1 

- • 

— - • 

Fig.  9 — Exccrpf  from  326X)A  job  invonlory 
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Table  22 

SPECIALIST  TASK  ANALYSIS  OK  INTEGRATED 
AVIONICS  SYSTEMS 


Task  Support 


Degree  of  difficulty  Task  requirements 

% men  performing  Equipment  required 

Frequency  of  task  Mission  criticality 


T rajjij^ng  Support 


Training  required  to 
perform  task 
Facilities  required 


Related  systems  knowledge 
requi red 

Other  related  knowledge 
required 


From  the  point  of  view  of  training  content , we  were  especially 
concerned  with  the  training  support  category.  The  task  analysis 
expanded  this  category  into  a matrix  with  tasks  as  the  rows  and 
subject  matter  and  mode  of  the  training  required  for  each  task  as  the 
columns.  This  matrix,  along  with  a summary  of  the  Mountain  Home  AFB 
data,  is  shown  in  Table  23. 

The  task  analysis  was  too  aggregated  to  permit  the  selection  of 
training  content.  A number  of  the  "tasks"  are  not  tasks  at  all  (e.g., 
modes  of  operation  under  INS  and  DCC  are  "subject  knowledge").  Almost 
all  of  the  "tasks"  are  composed  of  sets  of  tasks,  many  of  which  differ 
significantly  from  others  in  their  implications  for  training.  The 
training  focus  is  also  far  too  general.  Does  "system  theory"  mean  the 
theory  of  how  the  system  works  or  how  it  was  built,  or  does  it  mean 
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Table  23 

MOUNTAIN  HOME  INTEC.RATKn  AVIONICS  SYSTEM  SPECIALISTS  TASK  ANALYSIS; 
TRAINING  REQUIRED  TO  II.REORM  TASK 
(PERCENT  EAVORING) 


Training Type  Training 


Task 

Electronic 

Funda- 

mentals 

System 

Theory 

Trouble- 
shoot ing 

System 
Integra- 
t Ion 

Advanced 

System 

Theory 

Formal 

OJT 

TTC 

FTD 

Attack  R<idjr  System 

Perform  opera t ion^i  1 checkout 

9 

80 

29 

69 

6 

80 

80 

0 

80 

Identify  controls / tunc t Ions 

17 

100 

U 

29 

6 

80 

40 

0 

80 

Analyze  nodes  of  operations 

29 

100 

29 

100 

14 

86 

83 

6 

80 

Perform  self  test /bu 1 1 t-ln  test 

11 

91 

17 

46 

0 

77 

77 

0 

77 

Perform  ad iustment /.i I i t'nment 

14 

77 

14 

0 

0 

66 

74 

0 

66 

Perform  t roubleshoot  in?; 

60 

94 

94 

97 

91 

100 

83 

3 

97 

Remove  and  replace  components 

3 

3 

0 

0 

0 

14 

91 

0 

14 

Terr^l^  Following  Radar 

Perform  operational  checkout 

6 

74 

23 

91 

9 

86 

91 

0 

86 

Identify  funct  lons/control.s 

6 

91 

9 

34 

11 

86 

34 

0 

86 

Interpret  displays 

26 

100 

17 

77 

17 

91 

97 

6 

86 

Perform  self  test /buf 1 t-ln  test 

9 

97 

49 

100 

29 

30 

30 

0 

30 

Perforin  ad  justment/al  l^nment 

9 

89 

17 

29 

46 

83 

74 

0 

83 

Perform  troubleshooting 

69 

100 

97 

97 

89 

100 

91 

0 

100 

Remove  and  replace  components 

0 

0 

0 

0 

0 

6 

94 

0 

6 

INS  and  DCC 

Operational  checkout 

9 

100 

6 

31 

0 

100 

89 

0 

100 

Controls/ funct Ions 

11 

97 

0 

66 

0 

100 

66 

0 

no 

Modes  of  operations 

6 

100 

0 

100 

77 

100 

37 

0 

100 

Self  teat/bullt-ln  test 

6 

100 

97 

49 

51 

100 

69 

0 

100 

Data  entry  procedures 

3 

100 

11 

6 

23 

100 

100 

0 

100 

Troubleshoot 

49 

100 

100 

51 

0 

100 

100 

0 

100 

Remove  and  replace 

0 

0 

0 

0 

0 

83 

100 

0 

83 

Dual  Bombing  Timer 

Operational  checkout 

0 

94 

0 

97 

0 

66 

91 

0 

86 

Interpret  displays 

0 

100 

0 

0 

0 

97 

17 

0 

97 

Optical  Display  SlRht 

Operational  checkout 

0 

100 

14 

74 

6 

86 

91 

0 

86 

Controls/funct ions 

0 

97 

0 

86 

20 

100 

91 

0 

100 

Nodes  of  operations 

0 

100 

29 

89 

51 

97 

49 

0 

97 

Self  test 

6 

97 

20 

11 

0 

57 

86 

0 

57 

Troubleshoot 

49 

100 

100 

97 

51 

100 

91 

0 

100 

Remove  and  replace 

0 

0 

0 

0 

0 

29 

100 

0 

29 

Systems  Integration 

Analyze  system  Integration 

83 

100 

94 

100 

74 

100 

100 

0 

100 

Troubleshoot 

94 

100 

100 

100 

94 

100 

100 

0 

100 

Electronic  Altimeter  s tern 

Operational  checkout 

29 

100 

20 

100 

40 

97 

80 

0 

97 

Control /funct ions 

0 

100 

0 

0 

0 

100 

9 

0 

100 

Displays 

29 

100 

20 

43 

0 

100 

80 

0 

100 

Self  test/bullt-ln  test 

20 

94 

29 

97 

0 

86 

97 

0 

86 

Troubleshoot ing 

57 

100 

100 

100 

83 

100 

91 

0 

100 

RtfUove  and  replace 

0 

0 

0 

0 

0 

80 

100 

0 

80 
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whiil  the  sysl«-m  does?  Furthermore,  how  does  it  differ  from  "advanced 
system  theory?"  In  particular,  the  task  analysis  indicates  that  in 
the  seven  system  areas,  it  is  important  to  teach  troubleshooting  in 
order  to  perform  troubleshooting,  which  hardly  provides  insight  into 
how  troubleshooting  should  be  taught.  Nor  does  the  survey  indicate 
what  are  necessary  electronics  fundamentals.  In  most  cases,  a 
majority  of  the  respondents  indicated  electronics  fundamentals  were 
needed  for  troubleshooting,  particularly  in  systems  integration.  But 
what  f undamenta 1 s--d i g i ta 1 systems,  oscilloscopes,  the  theory  of 
electron  flow?  The  Mountain  Home  AFB  survey  did  include  a list  of 
" recommi’iided  technical  training  center  subjects,"  but  it  did  not  list 
the  majority  of  topics  taught  in  the  electronics  fundamentals  course. 
Thus,  tag's  input  to  this  task  analysis  was  undermined  by  the 
questions  ATC  chose  to  ask. 

To  some  extent,  the  Air  Training  Command  understands  these 
problems.  Of  the  several  ways  of  gathering  job-related 
information--occupational  survey,  questionnaire,  checklist,  individual 
interview,  and  observation  interview--the  Air  Force  rates  the 
observation  interview  highest  in  terms  of  the  specificity, 
completeness,  and  accuracy  of  the  information  obtained.* 

Unfortunately,  it  is  generally  argued  that  an  adequate  task  analysis 
is  too  expensive  to  conduct.  This  seems  "penny  wise,  pound  foolish"  if 
the  result  is  an  inappropriate  course  and  poorly  trained  personnel,  or 
personnel  trained  in  irrelevant  knowledge  or  use'less  skills. 

The  Electronics  Principles  Inventory  recently  developed  by  ATC's 


*AFM  50-2,  p.  2-6. 
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Occupational  Mcasurcmfiil  Center  holds  promise  for  assessing  knowledge 
requirements.  Preliminary  trials  of  the  Inventory  suggested  that  in 
some  career  fields  as  much  as  87  percent  of  the  training  in 
electronics  principles  was  never  used  on  the  job.-' 

The  Adequacyof  the  Specialty  Training  Standard 

The  Specialty  Training  Standard  defines  not  only  the  tasks  to  he 
taught  before  a T- level  can  be  .iwarded,  but  the  level  of  proficiency 
required.  In  addition,  it  plays  major  roles  in  task  analysis, 
training  evaluation,  and  promotion  and  is  often  cited  by  ATC  as  one  of 
the  significant  steps  in  training  management  where  the  using  commands 
can  have  a major  impact."'"' 

The  STS  sets  forth  standards  of  knowledge  and  proficiency  in  task 
performance  that  are  to  be  attained  before  the  airman  can  be  awarded 
each  skill  level.  But  the  standards  for  knowledge  and  performance  are 
stated  in  the  same  terms  for  all  jobs  at  all  skil>  lo»'<»ls  in  all 
specialties.  Consequently,  these  terms  are  so  gent.»„_  that  they  are 
ambiguous  and  only  tenuously  related  to  the  performance  of  a particular 
task.  As  early  as  1969,  Hunter  et  al.,  in  a Human  Resources  Research 
Office  study  for  OASD  (M&RA) , noted  that 

The  JTS  (the  former  term  for  the  STS)  in  its  present 
form  is  ...  a document  containing  "general  tasks, 
knowledges,  and  proficiency  level  requirements."  It  is 
intermediate  between  a job  description  and  a listing  of 
learning  objectives,  and  hence  serves  to  obscure  rather 
than  delineate  a precise  relationship  between  them. 

*Thomas  J.  O'Connor,  A Universal  Model  for  Evaluating  Basic 
Electronics  bourses  inJTerms  of  Field  Utilization  of  Training,  USAF 
Occupational  Measurement  Center,  Lackland  AFB,  Texas,  1975,  p.  13. 

**Air  Force  Regulation  8-13  sets  out  procedures  by  which  the  using 
commands  review  and  concur  with  the  STS. 
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The  Air  Force  Job  Training  Standard  ...  i.s 
inadequately  derived  for  the  system's  needs  and 
insufficiently  precise  to  serve  as  an  ideal  set  of 
sppci  f ications 

For  example,  a common  standard  for  task  performance  for  graduates  of 
an  entry-level  course  is;  "Can  do  most  parts  of  the  task.  Needs  help 
only  on  the  hardest  parts.  May  not  meet  local  standards  for  speed  and 
accuracy."  With  standards  such  as  these,  doubtlessly  the  evaluators 
of  the  Lowry  AFB  course  discussed  in  Sec.  IV  could  state  with  a clear 
conscience  that 

The  training  department's  analysis  of  the  field 
questionnaire  was  that  all  STS  items  were  being  taught  to 
the  code  level  given  in  the  training  standard. 

Because  the  STS  gives  training  standards  for  the  entire 
specialty,  it  is  oriented  toward  career  progression  and  emphasizes 
general  subject  knowledge  rather  than  specific  task  knowledge  required 
on  the  job.  Thus,  it  tends  to  steer  the  Plan  of  Instruction  away  from 
teaching  job  performance. 

Additionally,  since  proficiency  requirements  are  so  ambiguous,  it 
is  net  surprising  that  even  this  tenuous  relationship  is  sometimes 
violated  by  the  POI,  as  was  the  case  in  the  pre-1975  Bomb/Nav  course. 
The  STS  required  that  the  3-level  graduate  be  able  to  "perform"  most 
parts  of  the  operational  checkout  of  the  major  systems.  Yet  the  Plan 
merely  required  that  "given  the  T.O.s,"  students  be  able  to  "list  the 

*Harold  G.  Hunter  et  al.,  The  Process  of  Developing  and 
Improving  Course  Content  for  Military  Technical  Training , Human 
Resources  Research  Office,  The  George  Washington  University, 
Washington,  D.C.,  Technical  Report  69-9,  May  1969  (words  in  brackets 
added) . 
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slrjis  in  pi' r t orm  I iiK  lli«'  opi'rjt  ion;i  1 clu't'konl  . " Ihi'sc  slops  .iio,  i»l 
loiirso,  lisloil  III  I ho  I ocliii  i c'.i  1 onlors. 

Koi  .1 1 ! , also,  tli.il  I ho  STS  si'ts  oiil  st  .iii'la  nls  (or  joli  proliiioiiiy 
trainiiiK  ami  Iho  I'aroor  Dovo  1 opmoiil  Coiirso,  Iho  two  facols  ol  O.Jl  . 
Suporvisors  prohalily  iiso  Ihoir  own  jinlgmonl  in  <ipplyinf<  Vtio  STS  as  a 
Riiiilo  for  joh  prolioioiuy  Iraining,  liul  Ifu*  COC  is  anothor  mattor.  It 
is  proparod  hy  Air  Training  Comniami  siihjort  mattor  spocialists  ami  is 
llio  solo  sourco  for  tlio  Spooialty  Knowlodj'o  Tost,  passage  of  which  is 
ri'ipiirod  for  upgrading.  Kathor  tlian  h<'ing  dorivod  from  an  indopondonf 
analysis  of  tfie  spoci.ilty,  howovor,  tho  Tost  is  likoly  to  fio  dovolopod 
.iftor  tlio  POl  and  roflotl  tho  fourso,  rather  than  to  provide  guidance 
on  flow  the  course  shoiilil  ho  conslruclod.  For  example,  in  the  recent 
revision  ol  32632A  training  a plan  was  lieveloped  without  an  approved 
STS.  Kvon  more  anomalous  was  the  original  326X2A  STS,  which  reipiired 
knowledge  of  the  FB-111  system  because  the  technical  school  had  FB-111 
trainers  and  the  FOl  referenced  the  FB-111  system.  As  noted  in  the 
preceding  section,  knowledge  of  the  FB-111  does  not  translate  into 
useful  job  knowledge  for  a person  maintaining  advanced  avionics  on 
other  F-111  models.  In  tact,  to  master  the  Career  Development  Course, 
TAC  personnel  had  to  review  what  they  had  learned  about  the  FB-111  at 
Lowry  AFB,  since  they  had  used  little  of  this  knowledge  on  the  job. 
Thus,  via  the  Career  Development  Course  and  the  Specialty  Knowledge 
Test,  the  Specialty  Training  Standard  reinforced  the  content  of  the 
Plan  of  Instruction. 

THK  PLAN  OF  INSTRUCTION 

It  has  been  seen  that  for  several  reasons  current  procedures 
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|irovi(l<*  i dirt-rtion  lor  dove  1 opmeril  ol  the  POI  , with  Iho 

rosiill  lli.it  .1  largo  amoiitit  of  oxpi'r  i out  f and  .subject  ivc‘  judgment  are 
used  in  its  construction.  This  proiess  cannot  help  hut  reflect  hotfi 
the  tr.iining  environment  itself  and  the  predispositions  of  ttie  subject 
in.ittc-r  experts.  For  example,  the  single  line  in  tfie  STS  reijuiring 
that  a :i2bT2A  airman  be  able  to  "explain  relat  ionshipfs ) of  tiasic 
facts  and  state  general  principles  about  ...  electronics  principles 
applicable  to  tasks  listed  in  this  STS"  was  translated  into  over  40 
percent  of  the  formal  course.  Similarly,  we  were  told  by  personnel 
from  the  Lowry  Technical  Training  Center  that  since  the  326X2A 
specialty  task  analysis  discussed  above  was  of  "poor  quality,"  it  was 
not  used  in  the  recent  revision  of  the  training  plan.  The  new  plans 
will  reflect  what  has  gone  before  rather  than  an  analysis  of  the 
reipji  rements  of  the  job.  The  Phase  II  courses  at  the  FTDs  will  te.ich 
the  performance  of  tasks  that  were  in  their  former  7- level  course  and 
that  can  be  carried  out  on  bench  trainers  already  available.  The 
basic  electronics  course  adds  or  takes  away  topics  rather  than 
selecting  the  portion  of  a topic  that  is  applicable  to  the  32632A  job. 

It  is  unfortunate  that  in  the  development  of  the  POI,  task 
analysis  and  the  whole  concept  of  Instructional  Systems  Development 
have  become  an  end  in  themselves,  instead  of  means  to  an  end. 
Instructional  Systems  Development  and  task  analysis  are  merely  tools 
that  may  be  useful  in  providing  relevant  training.  As  with  any  tools, 
they  may  be  properly  or  improperly  used.  The  fact  that  a course  has 
been  through  Instructional  Systems  Development  or  that  a task  analysis 
has  been  performed  does  not  automatically  make  it  a relevant  or 
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effective  course.  The  problem  of  bywords  in  traininK  is  not  new.  In 
1967  Folley  and  Elliott  wrote: 

People  in  high  places,  who  presumably  would  have  the 
authority  to  improve  the  quality  of  training  and  related 
activities  that  so  heavily  affect  maintenance,  normally 
reply,  "We're  already  doing  that"  when  suggestions  are  made 
or  questions  asked.  The  fact  is  that  a lot  of  "OK  words" 
are  being  effectively  applied.  An  incredible  discrepancy 
exists  between  what  the  fine  sounding  labels  imply  is  being 
done,  and  the  operations  that  are  actually  being  performed. 

For  example,  although  "task  analysis"  and  "training 
objectives"  are  said  to  be  in  use,  the  central  problem  of 
determining  valid  training  content  is  far  from  solution.* 


Formal  F.valuation 

Formal  evaluation  of  training  is  the  responsibility  of  the 
Evaluation  Department  in  the  ATC  technical  schools.  These  departments 
conduct  internal  and  external  reviews  of  both  the  process  and  product 
of  training.  Internal  evaluations  primarily  ensure  that  instructors, 
departments,  FTDs,  and  other  agencies  within  the  command  are  adhering 
to  stated  policy.  External  evaluation  ensures  that  graduates  of  ATC 
courses  are  trained  to  levels  of  proficiency  as  set  forth  in  the 
Specialty  Training  Standard.  ATC  has  devised  a highly  structured  and 
extensive  program  for  formal  evaluation. 

The  fundamental  problem  with  the  formal  evaluation  program  is 
that  self-evaluation  is  rarely  candid.  For  example,  the  ATC  trip 
report  of  April  197A  discussed  in  Sec.  IV  was  highly  critical  of  both 
the  content  and  conduct  of  the  course  given  at  Lowry  AFB  and  ended 
with  the  statement,  "Most  graduates  interviewed  considered  the  Lowry 

*John  D.  Folley,  Jr.,  and  Thomas  K.  Elliott,  A f^iejd  Sujrve^  of 
Electronic  Maintenance  Technical  Data,  Air  Force  Systems  Command, 
AMSrL-TR-67-159,  November  1967,  p.  25. 
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ri)iirs«>  I ndilfqiiaLi'  for  doing  thrir  job."  Despite  this  candid  input, 
the  Training  Evaluation  Report  concluded  that 


Internal  review  of  the  course  did  not  indicate  any  training 
deficiencies  other  than  down  time  of  training  equipment. 


Personal  interviews  with  graduates  and  supervisors  of 
graduates  seemed  to  indicate  that  the  graduates  were  not 
fully  trained  on  all  models  of  the  F-111  aircraft  and  that 
additional  training  was  required  before  the  graduates 
became  fully  productive.  This  is  a normal  condition  where 
the  graduates  may  be  assigned  to  more  than  one  model 
aircraft . 

Recommend  that  training  department  (TAV)  and  Training 
Plans  (TTOX)  personnel  select  additional  trainer(s)  that, 
when  used  with  the  present  trainers,  will  provide  the 
airman  adequate  training  on  the  F-111  weapons  systems 
peculiar  to  his  AFSC. 

1 nput^  from  the  Users  of  Trained  Personnel 

The  commands  receiving  graduates  of  ATC  courses  make  both 
informal  and  formal  inputs  to  the  management  of  training.  The  most 
revealing  recent  example  was  TAC's  effort  to  have  the  content  and 
conduct  of  the  Lowry  AFB  course,  discussed  in  Sec.  IV,  revised  by  ATC. 
At  the  Avionics  Superintendent  Steering  Group  Meeting  in  the  spring 
of  197A  at  Lowry  AFB,  TAC  not  only  expressed  their  dissatisfaction 
with  representative  training  but  also  noted  that  responses  to  most  of 
the  questionnaires  they  had  administered 


. . . indicated  that  the  training  received  did  not  adequately 
prepare  them  for  the  tasks  they  are  required  to  perform  in 
the  field....  The  most  frequent  complaint  concerned  the 
fact  they  had  received  little  or  no  practical  training. 
Although  not  directly  related  to  the  [representative 
training]  concept,  the  lack  of  practical  training  has 
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coni r ibulcd  to  the  overall  ineffectiveness  of 
represent  at  i ve  I ra  i n i n^ . 

Yet  the  ASSG  report  recommended  only  that  "repres«Titat  i v<‘ 
training  ...  be  replaced  with  weapon  systems  oriented  training,"  atnl 
sai<l  nothing  about  teaching  job  performance.  As  we  have  .irgiied, 
weapon  system  training  is  necessary  but  not  sufficient  to  ensure 
training  in  job  performance.  Thus,  TAG  did  not  follow  through  on  this 
important  training  input. 

A conference  was  held  at  Randolph  Air  Force  Base  on  September 
^-6,  197A,  to  implement  ASSG's  findings  The  minutes  of  the 
conference  note: 


Basic  technical  training  will  be  reoriented  away  from 
representative,  primarily  principle-centered  instruction 
towards  more  specific,  primarily  weapon  systems-centered 
instruction.  Aljthc^u^h  a thorough  Instructional  Systems 
Development  (ISD)  is  required  before  specifics  are  known, 

^ can  ^e  stated  that  the  genera  1 pattern  will  consist  of 
electronics  principles  training,  a block  of  training  common 
to  a ^re^  as  a whole,  and  finally,  "tracking"  or 
"channelizing"  the  student  to  the  specific  weapons^  systems 
he  will  be  assigned  to  on  his  first  tour.** 

Despite  the  lip  service  to  Instructional  Systems  Development,  the 
Conference,  without  analysis  of  actual  content  of  the  job  or 
alternative  training  possibilities,  endorsed  the  two-phase 
fundamentals  general  equipment  approach  to  training  and  added  a third 
phase  for  teaching  specific  equipment.  As  a result,  the  total  length 
of  training  remained  about  the  same,  basic  electronics  training  was 

*Minute8  of  TAG  briefing  presented  at  the  Avionics  Superintendent 
Steering  Group  Meeting,  Lowry  Air  Force  Base,  May  27-31,  197A. 

**Conference  minutes  on  Classification  and  Training  of  AFSC  326XX 
Integrated  Avionics  (emphasis  added). 


.K'tii.illy  oxp.iiuled , and  pratliial  training  remained  the  responsibility 
of  local  units. 

Two  points  at  which  users  of  trained  personnel  make  formal  input 
to  training  inan.igement  are  evaluation,  and  review  and  approval  of  the 
Specialty  Training  Standard.  To  encourage  command  evaluation  of 
training,  ATC  has  provided  all  field  supervisors  with  Form  1284, 
titled  "Training  Quality  Report,"  on  which  they  may  designate  areas 
where  course  graduates  are  deficient.  However,  supervisors  are  asked 
to  evaluate  the  graduate  against  the  ^oals  of  the  STS.  Thus,  through 
its  control  of  the  STS,  ATC  sets  the  goal  and  then  asks  to  be  evaluated 
against  the  goal.  Moreover,  the  goals  themselves  are  ambiguous,  as 
noted  previously.  It  is  not  surprising  that  practically  no  Training 
Quality  Reports  are  submitted  from  the  field.  Rather  than  proving  that 
the  commands  are  satisfied  with  the  ATC  product,  this  indicates  the 
inadequacies  of  Form  1284  as  a mechanism  for  training  evaluation. 

Folley  and  Elliott  have  argued,  and  we  agree,  that  the  goals 
"should  be  reviewed  to  reflect  performance  in  terms  of  demonstrated 
accomplishment,  which  can  be  specified  in  terms  of  time  and  errors."* 

In  fact.  Maintenance  Quality  Control  at  the  various  operating  bases 
has  established  standards  for  speed  and  accuracy  on  many  tasks. 

There  are  similar  problems  with  command  review  and  approval  of 
the  STS  outside  of  ATC.  For  example,  it  is  unlikely  that  TAC  realized 
when  it  approved  the  Standard  that  the  references  to  the  FB-111 
required  TAC  personnel  not  only  to  learn  but,  after  being  in  the 
field,  to  be  tested  on  their  knowledge  of  features  unique  to  a SAC 

*John  D.  Folley,  Jr.,  and  Thomas  K.  Elliott,  A Field  Survey  of 
Electronic  Maintenance  Technical  Data,  Air  Force  Systems  Command, 
AMRL-TR-67-r‘)9,  November  1967,  p.  30. 
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system.  After  talking  to  people  at  TAG,  we  tonelude  that  TAC's 
approval  of  the  STS  is  usually  granted  without  a real  effort  on  TAC's 
part  to  understand  its  content  and  implications. 

SUMMAKY 

The  recent  history  of  the  evolution  of  the  Bomh/Nav  course 
illustrates  the  difficulties  of  maintaining  relevance  in  training  for 
a rapidly  changing  job.  Training  managers  and  avionics  personnel  in 
both  ATC  and  TAG  tried  to  cope  with  this  problem,  but  their  efforts 
were  diluted  at  two  key  points--the  command  evaluation  and  the  task 
analysis.  The  lack  of  success  was  partly  caused  by  the  way  each  key 
step  in  the  management  process  ultimately  passes  through  the  same 
filter--the  subject  matter  experts  in  Air  Training  Command. 

For  a number  of  years  ATC  has  been  aware  of  the  difficulties  of 
devising  procedures  for  the  management  of  training  that  will  ensure 
its  relevance.  Considerable  time  and  effort  have  been  devoted  to 
developing  and  perfecting  such  techniques  as  the  Occupational  Surveys 
and  Instructional  Systems  Development  to  try  to  solve  this  problem. 

Yet  it  remains. 

There  is  a central  lesson  in  ATC's  inability  to  deal  with  the 
problem  more  effectively;  ATC,  working  alone,  cannot  ensure  the 
relevance  of  training.  The  most  obvious  reason  is  the  tendency  of  any 
organisation  to  subvert  sel f-critique . More  important  is  the  need  for 
active  command  involvement  in  the  management  of  training.  Without 
continuous,  open  direction  and  feedback  from  the  users  of  trained 
personnel,  ATC  must  fall  back  on  its  own  subjective  perceptions  and 
assessments.  In  the  next  section  we  suggest  management  procedures  for 
improving  the  responsiveness  of  training  to  command  needs. 
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VII.  CONCLUSIONS  ANU  RECOMMENDATIONS 


In  this  section  we  use  conclusions  from  the  foregoing  discussion 
to  derive  recommendations  for  improvements  in  training  for  flight-line 
maintenance  of  advanced  avionics  and  in  training  management. 

CONCLUSIONS 

The  analysis  described  in  this  report  focused  on  a fundamental 

problem  in  Air  Force  technical  training;  in  many  instances  formal 

training  is  not  sufficiently  relevant  to  the  job.  This  statement  is 

supported  by  extensive  research  in  training  that  goes  well  beyond  our 

^ examination  of  integrated  avionics. 

' 

The  result  of  irrelevant  training  is  not  only  that  formal 
training  resources  are  wasted  but,  more  serious,  that  operational 
effectiveness  may  be  diminished  because  airmen  do  not  perform  tasks 
competently.  The  integrated  avionics  career  field  made  a unique 
contribution  to  the  related  research  mentioned  above  by  highlighting 
these  kinds  of  inadequacies.  Unlike  those  in  most  other  career 
fields,  many  of  the  more  advanced  maintenance  personnel  in  integrated 
avionics  lack  the  knowledge  and  experience  needed  to  fill  gaps  in 
formal  training  through  OJT.  The  situation  was  particularly  difficult 
at  Cannon  AFB  where  the  few  people  who  understood  the  system  carried 
such  a heavy  maintenance  load  that  they  could  not  take  time  to  pass 
their  knowledge  along  to  others. 

Both  ATC  and  TAG  took  steps  to  alleviate  these  problems.  Their 


efforts  shed  additional  li  ght  on  the  sources  of  irrelevant 
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t ra  1 ti  i iig- -A  i r Force  I raining  policn-s  anil  the  managemt'iil  of  training 
within  ATC  and  the  MAJCOMs. 

Training  tor  Flight-Line  Ma  i nteriane^ 

To  examine  the  training  program,  w<>  first  estahlished  the  nature 
of  the  job  through  direct  observation  of  job  per formanee , interviews 
with  job  pc'rformers,  and  analysis  of  ttie  content  of  atioiit  200  jobs 
rerordcol  during  a two-week  period  at  Cannon  AFB.  The  analysis  showeil 
that  the  most  dem.inding  part  of  the  ioh--fault  i so  lat  ion-- reipi  i res  the 
informed  use  of  combinations  of  the  external  indicators  provided  by 
the  system;  this,  in  turn,  requires  that  the  airman  know  how  the 
system  is  integrated,  what  functions  are  performed  in  what  boxes,  and 
how  a failure  in  a particular  box  affects  the  system.  Furthermore, 
the  avionics  subsystems  on  each  model  of  the  F-111  are  integrated  so 
differently  that  knowledge  of  one  model  does  not  mean  it  will  be  easy 
to  understand  another. 

In  the  discussion  to  follow,  we  focus  on  training  for  the  .326X2A 
career  field,  where  training  deficiencies  were  most  obvious.  The 
first-term  maintenance*  force  (the  bulk  of  the  job  performers)  had  been 
trained  in  a course  that  began  with  six  weeks  of  basic  electronics 
theory;  only  one  or  two  weeks  of  this  was  related  to  job  performance 
or  even  to  subsequent  instruction  in  the  course.  The  second  part  of 
the  course  familiarized  trainees  with  each  of  several  avionics 
subsystems  in  turn.  These  subsystems  were  taken  from  the  FB-111 
integrated  avionics  system,  which  has  some  equipment  not  found  on  any 
other  model  of  the  F-lll  and  lacks  some  equipment  that  is  crucial  to 
other  models.  Only  about  10  percent  of  the  graduates  of  the  course 


wore*  destined  to  work  on  FB-llls.  In  g<Mieral,  this  part  of  the  course 
was  abstract  and  only  indirectly  related  to  job  performance.  The 
inade(iuacy  of  this  course  as  preparation  for  the  job  was  verified 
through  several  independent  efforts  as  well  as  our  own. 

Training^  Policy 

The  use  of  the  FB- 1 1 1 as  a vehicle  for  training  and  the  emphasis 
of  the  course  on  abstract  knowledge  were  partly  consequences  of  Air 
Force  training  policy.  Traditionally,  initial  training  has  been 
designed  to  provide  a base  for  an  airman's  performance  of  various 
duties  as  he  progresses  in  his  specialty  and  as  he  works  on  the 
various  weapon  systems  assigned  to  his  AFS . Such  training  has 
stressed  general  knowledge  related  to  the  career  field  rather  than  the 
specifics  of  the  job.  Acquisition  of  generalized  principles  is 
supposed  to  equip  the  graduate  to  transfer  what  he  has  learned  about  a 
particular  system,  such  as  the  FB-111,  to  other  systems  to  which  he 
may  be  assigned  either  initially  or  later  in  his  career.  This  is 
presumed  to  facilitate  flexible  assignment  of  personnel  among  bases 
and  weapon  systems.  In  the  case  of  integrated  avionics,  however, 
there  was  little  transfer  of  learning  because  of  the  irrelevance  of 
the  general  principles  taught  and  the  idiosyncratic  nature  of  advanced 
avionics  systems.  In  addition,  only  about  lA  percent  of  the 
technicians  were  staying  in  the  Air  Force  until  their  fifth  year  of 
service.  Thus,  career-oriented  training  that  does  not  directly 
support  job  performance  is  largely  wasted  in  this  career  field. 


138 


Improving  Training  Relevance 

In  an  effort  to  better  prepare  326X2A  personnel,  TAG  implemented 
a very  different  training  approach  at  Cannon  AFB  under  its  Task 
Oriented  Training  program.  Instructors  from  the  Cannon  P'TD  worked 
with  TAC  technicians  to  design  the  course  and  carry  out  the  training, 
which  was  given  in  a hangar  using  aircraft  from  the  operating 
inventory.  Trainees  began  by  learning  to  remove  and  install  LRUs, 
progressed  to  operation  and  operational  checkout  of  the  avionics 
subsystems,  and  ended  by  doing  simple  troubleshooting.  The  course 
took  about  three  weeks  and  produced  graduates  whom  supervisors  could 
use  immediately. 

The  Task  Oriented  Training  program  made  several  significant 
points.  It  showed  that,  given  strong  support  by  the  wing  commander, 
it  is  possible  for  the  providers  of  training  and  the  users  of  trained 
personnel  to  work  together  to  resolve  problems  of  training  relevance. 
It  also  demonstrated  that  it  is  possible  to  teach  job  performance  in 
formal  training,  a major  recommendation  of  this  study. 

There  is  a considerable  body  of  research  that  supports  our 
contention  that  job  performance  can  be  taught  in  formal  training.  But 
courses  designed  in  these  demonstrations  have  not  been  permanently 
implemented  because  they  have  been  incompatible  with  training  policy. 
In  addition,  even  in  the  face  of  a serious  mismatch  between  training 
and  the  job,  it  is  difficult  for  ATC  to  avoid  perpetuating  existing 
training  content,  as  is  illustrated  by  ATC's  efforts  to  improve 
initial  training  for  326X2A  personnel.  During  1975,  ATC  designed  and 
implemented  a new  course  for  this  career  field.  It  was  still  in  two 
parts,  but  only  the  first  was  given  at  the  technical  school;  the 
second  was  given  at  the  FTDs  at  each  base  that  used  326X2A  personnel. 
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The  purpose  of  this  change  was  to  orient  the  systems  portion  of  the 
training  to  the  particular  aircraft  to  which  the  graduate  would  be 
assigned . 

Although  this  was  a step  in  the  right  direction,  several  prob- 
lems remained.  First,  the  basic  electronics  portion  of  the  course 
was  actually  lengthened;  moreover,  the  physical  separation  of  the  two 
parts  of  the  course  reinforced  the  separation  of  the  theory-oriented 
portion  from  job  performance.  Finally,  although  the  FTD  courses  were, 
by  and  large,  more  relevant  to  the  job,  they  were  not  based  on 
analysis  of  the  job  but  on  the  FTD  courses  that  had  been  given  earlier 
for  system  familiarizatio'n.  The  result  was  that  they  stressed 
familiarization  with  particular  weapon  systems,  not  necessarily 
performance  of  maintenance  tasks. 

Training  Management 

The  Air  Training  Conmand  response  illustrates  a general  problem 
for  training  management--the  difficulty  of  keeping  existing  training 
procedures  and  resources  from  dictating  course  design  and  course 
content.  In  recognition  of  this  difficulty,  ATC  has  devised  several 
processes  for  linking  training  to  the  needs  of  the  field.  These  links 
are  often  ineffective,  however,  for  two  reasons.  One  is  that  all  of 
them  depend  for  their  detailed  specification  and  implementation  on  the 
subjective  judgment  of  ATC  school  personnel,  which  is  naturally 
colored  by  the  training  command  environment.  The  second  reason  is 
that  the  HAJCONs,  in  the  past,  have  viewed  training  as  largely  ATC's 
business  and  have  not  aggressively  pushed  their  training  concerns  via 
the  mechanisms  that  ATC  has  provided. 


a. 


140 


RKCOMMKNDATIONS 

Thf  refoitimciKlat  1 ons  tall  into  the  arras  of  training  content, 
location,  and  timing.  The  Air  Force  has  already  taken  action  in  some 
of  the  directions  we  believe  are  desirable.  The  development  of 
training  in  the  326X2  AFS  makes  i clear,  however,  that  it  is  not  easy 
for  the  training  program  to  keep  up  with  the  neeils  of  the  field.  We 
believe  that  improved  management  procedures  are  critical.  We 
therefore  also  recommend  changes  in  procedures  for  designing  and 
evaluating  training  programs  that,  we  believe,  would  improve  both  the 
effectiveness  and  the  efficiency  of  Air  Force  training  in  areas  which, 
like  advanced  avionics,  are  undergoing  rapid  technological  change. 

Training  for  Flight-Line  Maintenance  of  Advanced  Avionics 

Content  j Tej®9^  Job  Performance  . Formal  instruction  in 

performance  of  flight-line  maintenance  jobs  would  make  more  efficient 
use  of  Air  Force  resources  and  at  the  same  time  would  improve  job 
performance.  A necessary  first  step  is  to  determine  what  job 
performance  requires  in  terms  of  skill  and  knowledge;  previous  work 
has  shown  that  it  is  particularly  important  to  determine  how  fault 
isolation  is  performed  for  integrated  systems.*  A member  of  the  Rand 
engineering  staff  has  investigated  this  issue  in  depth  for  the  F-lllD 
and  has  synthesized  an  outline  of  a course  whose  graduates  would  be 
immediately  productive  on  the  flight  line  and  would  also  have  the 
understanding  of  system  integration  required  for  most  fault 

♦Polly  Carpenter-Huf fman,  John  Neufei , and  Bernard  Rostker, 
AnaJ_ysis  of  the  Content  of  Advanced  Avionics  Maintenance  Jobs , 
R-2017-AF,  the  Rand  Corporation,  and  Richard  E.  Duren,  A Proposed 
Course  tor  Avionics  Technicians,  R-2049-AF,  The  Rand  Corporation. 
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isolation."'  Similar  analysis  is  nerdod  to  build  training  for 
flight-line  maintenance  of  the  other  models  of  the  F-111,  F-15,  and 
F-  16. 

Training  should  concentrate  on  the  development  of  job  performance 
skills  in  a reasonable  facsimile  of  a job  setting.  Particularly  for 
flight-line  maintenance  of  advanced  avionics,  training  on  system 
integration  should  be  carried  out  on  a truly  integrated  system--that 
is,  either  on  the  aircraft  itself  or  on  a reasonable  facsimile  of  it. 
(A  reasonable  facsimile  is  one  in  which  all  systems  interact  that 
interact  on  the  aircraft.)  In  some  instances,  it  may  be  desirable  to 
design  new  trainers  or  maintenance  simulators  that  have  this  feature. 

It  is  crucial  that  instructors  know  the  job  intimately  and  are 
adept  at  teaching  job  performance.  This  will  requi.e  them  to  perform 
the  job  on  the  flight  line  at  frequent  enough  intervals  to  remain 
current  (perhaps  as  determined  by  their  ability  to  do  the  more 
demanding  task  or  tasks  for  which  procedures  have  recently  been 
revised)  and  to  learn  how  to  guide  trainees  through  task  performance 
(rather  than  showing  and  telling  them  how  it  is  done). 

Only  job  performance  should  be  taught  initially,  that  is,  alj.  of 
the  content  of  training  should  support  job  performance  directly, 
because  so  few  airmen  make  careers  of  the  326X2X  specialties  that 
generalized/theoretical  training  intended  as  a basis  for  career 
advancement  is  largely  wasted. 

Location:  Train  for  Uue  Job  Wher^  the  Job  . Our  proposal 
that  the  bulk  of  326X2  training  be  strongly  oriented  to  the  tasks  a 


*R-2049-AF. 
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man  will  perform  on  a particular  aircraft  mtxlel  and  the  d i ( f i cul t i es 
of  maintaining  such  an  orientation  for  many  diverse  aircraft  models  at 
a single  school  remote  from  operating  bases  argue  lor  moving  the 
training  to  the  operating  bases.  The  inefficiencies  in  the  use  of 
training  resources  that  will  result  from  sucfi  i change  are  more 
apparent  than  real;  centralized  training  is  less  efficient  because 
much  of  what  is  learned  there  is  either  forgotten  or  never  used.  The 
screening  function  provided  at  technical  school  could  better  be  done 
on  base,  where  an  airman's  willingness  and  ability  to  work  on  the  job 
would  be  assessed,  rather  than  his  survival  skills  in  an  academic 
envi ronment . 

To  be  effective,  base-level  job-oriented  training  requires  close 
cooperation  between  the  training  and  using  organizations. 

Specifically,  the  training  organization  must  see  its  primary  mission 
as  supporting  the  user's  iiranediate  training  needs;  the  using 
organization  must  see  training  support  as  of  primary  importance  to  its 
mission.  This  is  especially  true  at  CONUS  bases,  where  a large 
fraction  of  the  personnel  (26  percent  on  the  Cannon  AFB  flight  line  in 
1974)  are  3-levels  and  where,  as  a result,  the  base  is  being  used  for 
training  maintenance  personnel  as  well  as  pilots. 

Timing:  Training  and  the  Job  Should  Reinforce  One  Another . A1 1 
knowledge  or  theory  required  to  support  task  performance  should  be 
taught  only  during  the  actual  job  performance  instruction.  (This  is 
referred  to  as  training  "in  a functional  context."*)  Two  arguments 

*The  Human  Resources  Research  Office  has  developed  and 
demonstrated  this  concept  in  a number  of  programs.  See,  for  example, 
John  E.  Taylor,  Eugene  R.  Michaels,  and  Mark  F.  Brennan,  The  Concepts 
of  Performance-Oriented  Instructions  U^d  in  Developing  the 
Experimental  Volunteer  Army  Program,  HumRRO-TR-72-7 , March  1972. 
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support  this  conclusion.  First,  training  should  be  coherent  so  that 
it  is  obvious  to  the  trainee  how  all  of  what  he  is  learning  fits 
together  to  improve  his  skills  on  the  job.  Second,  teaching  the  more 
abstract  aspects  of  job  performance  only  as  required  during  training 
in  job  skills  helps  weed  out  unnecessary  theory.  Teaching  theory  only 
as  part  of  teaching  job  performance  will  require  a major  overhaul  of 
current  training  programs  but  will  probably  pay  for  itself  in  improved 
training  efficiency  and  effectiveness. 

During  initial  training  (not  after)  the  trainee  should  work  on 
the  flight  line.  (For  example,  he  could  go  to  school  in  the  morning 
and  work  in  the  afternoon.)  This  would  reinforce  learning  and  bring 
student-oriented  insights  to  the  classroom;  it  would  also  enhance  the 
relevance  of  training  content  to  job  performance  by  providing  a strong 
mechanism  for  communication. 

The  initial  training  in  the  326X2  AFS  should  be  carried  out  only 
on  the  ecjuipment  the  man  will  maintain  during  his  first  duty 
assignment.  When  and  if  he  is  assigned  to  maintain  significantly 
different  equipment,  he  should  be  required  to  be  trained  on  that 
equipment,  regardless  of  his  grade. 

In  specialties  such  as  the  326X2,  where  abstract  training  is 
initially  minimal,  a general  and  thorough  course  in  basic  electronics 
or  other  relevant  theory  might  be  offered  as  an  incentive  for 
reenlistment.  Such  courses  could  be  given  in  technical  school  or  at 
FTD.  If  the  course  is  given  at  the  FTD,  first-termers  should  be 
encouraged  to  study  theory  in  their  spare  time.  Alternatively,  or 
concurrently,  a self-study  package  could  be  provided  to  whoever  wants 


it. 
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Training  Managemcnl 

There  are  Ihree  areas  where  we  believe  the  inanagemenl  of  training 
<ati  be  imp  roved --making  I ns  t riic  t i ona  I Systems  Development  more 
etlective  in  ensuring  the  relevanee  ol  training  to  the  job,  improving 
the  c'onsunance  between  training  poli<y  and  the  part  i cti  lar  i t i es  of  each 
specialty,  and  getting  the  users  of  trained  personnel  more  effectively 
involved  with  training.  Unless  changes  are  made  in  these  areas, 
teaching  job  performance  in  avionics  maintenance  training  will  he  just 
one  more  demonstration  that  is  dropped,  after  an  initial  flurry  of 
support,  when  the  fundamr-ntal  countercurrents  in  the  training  system 
slowly  engulf  it. 

Strengthen  the  Instructional  Systems  Development  Steps  Relating 
Training  to  Job  Performance.  Presently,  the  ISD  links  between 
training  and  the  job  are  inadeipiate.  Usually  there  is  no  up-to-date 
task  analysis;  if  anything  is  available,  it  is  not  an  analysis  of  what 
a job  incumbent  needs  to  know  and  be  able  to  do  but  is  instead  an 
inventory  of  the  tasks  usually  performed  (an  Occupational  Survey 
report).  A task  analysis  should  establish  not  only  what  is  done,  but, 
more  important  from  the  standpoint  of  training,  what  knowledge  is  used 
on  the  job.  The  Klectronics  Principles  Inventory  demonstrates  the 
feasibility  of  such  an  approach.  Thus,  the  Occupational  Survey  should 
be  expanded  into  a skill  and  knowledge  analysis. 

The  last  step  in  Instructional  Systems  Development  is  field 
evaluation,  which  is  crucial  not  only  in  testing  the  effectiveness  of 
current  training  but  in  ensuring  that  training  remains  relevant. 
Because  of  deficiencies  endemic  to  self-evaluation,  field  evaluation 
.should  be  the  responsibility  of  an  agency  external  to  the  school  whose 
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ionise  is  lieing  eva  1 iiated--pre  t erably  external  to  technical  training 
itself.  Along  the  same  lines,  criteria  for  evaluation  should  be 
specified  by  other  than  course  personnel  or  technical  training.  They 
could  be  drawn  from  the  course  objectives  themselves,  from  performance 
standards  established  by  Quality  Control,  or  from  some  combination. 

Training  Policy:  Tailor  the  Amount  and  Timing  of  Generalized 
and  Career-Oriented  Training  to  the  Needs  of  Each  Specialty.  A 
fundamental  source  of  the  deficiencies  in  training  for  flight-line 
maintenance  of  advanced  avionics  is  ATC's  blanket  policy  that  initial 
training  should  prepare  the  airman  for  career  advancement  as  well  as 
for  OJT.  Such  a policy  may  be  desirable  for  specialties  where  the 
percentage  of  entering  airmen  who  make  the  specialty  their  career  is 
high  or  where  there  is  an  appreciable  amount  of  knowledge  that 
supports  most  of  the  jobs  in  the  specialty,  that  is,  is  general izable 
across  the  specialty.  The  326X2X  specialties  fit  neither  of  these 
criteria.  Thus,  a better  blanket  policy  would  be  that  the  phasing  of 
generalized  or  career-oriented  training  should  be  tailored  to  fit  each 
specialty. 

The  Usej;^ Make  the  Users  of  Trained  Pe^onnel  More  Active 

Partners  in  the  Training  Process.  Users  of  trained  personnel  quite 
naturally  view  their  mission  as  other  than  training  (even  though  some 
MAJCOM  bases  in  the  CONUS  are  primarily  pilot  training  bases). 
Dedication  to  the  mission  should  be  more  farsighted  than  is  often  the 
case.  For  example,  it  makes  no  sense  to  concentrate  resources  on 
training  pilots  to  the  detriment  of  keeping  their  aircraft  in 
flyable  condition.  Maintenance  training  should  be  emphasized  as 


strongly  as  pilot  training.  Both  at  headquarters  and  at  the  wing 
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I level,  positions  of  sufficient  authority  should  be  established  to 

ensure  the  support  of  maintenance  training.  The  Task  Oriented 
Training  program  at  Cannon  AFB  demonstrates  the  benefits  of  strong 
wing  support.  This  approach  should  be  extended  and  given  the  support 
needed  to  make  it  effective. 

User  participation  in  the  management  of  training  should  be 
strengthened  in  the  two  steps  of  Instructional  Systems  Developnient 
that  link  training  to  the  job--task  analysis  and  field  evaluation. 

The  user  should  be  active  in  choosing  the  tasks  to  be  taught  and  the 
proficiency  expected  of  the  graduate.  The  vague  codes  of  the 
Specialty  Training  Standard  should  be  replaced  by  criteria  specific  to 
each  task.  To  forestall  the  unsupportable  inflation  of  training 
^ requirements  that  might  result,  the  user  should  have  to  pay  for  the 

training  he  requires  either  in  dollars  or  other  resources.  Design  of 
effective  policies  and  procedures  needs  further  work. 

Similarly,  better  procedures  are  needed  to  involve  the  user  with 
field  evaluation.  There  is  no  substitute  for  nonthreatening  face-to- 
face  interviews  with  graduates  and  their  supervisors.  Questionnaires 
should  be  simple,  in  the  airman's  terms,  and  also  devoid  of  threat  to 
him.  Perhaps  they  should  be  processed  initially  by  people  in  the 
using  conmand  who  are  responsible  for  training,  rather  than  by  ATC. 
And,  most  important,  if  the  evaluation  reveals  flaws  in  training, 
positive  remedies  must  ensue,  preferably  from  user  participation  in 
their  formulation. 
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